[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:05:56 dist-test-slave-lgr5 krb5kdc[19141](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:05:56 dist-test-slave-lgr5 krb5kdc[19141](info): set up 2 sockets
Aug 12 11:05:56 dist-test-slave-lgr5 krb5kdc[19141](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 11:05:57.776221 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.005s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:05:57 dist-test-slave-lgr5 krb5kdc[19141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:05:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:05:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:05:57.905856 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:44729
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:46439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:44729
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:05:58.060667 19170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:05:58.061014 19170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:05:58.061084 19170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:05:58.065505 19170 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:05:58.065593 19170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:05:58.065623 19170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:05:58.065645 19170 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:05:58.065666 19170 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:05:58.071580 19170 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:44729
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:44729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19170
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:05:58.073261 19170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:05:58.074759 19170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:05:58.089824 19170 server_base.cc:1034] running on GCE node
W20260812 11:05:58.090749 19182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:05:58.092183 19180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:05:58.092412 19184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:05:58.093307 19170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:05:58.095309 19170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:05:58.096486 19170 hybrid_clock.cc:648] HybridClock initialized: now 1786532758096466 us; error 66 us; skew 500 ppm
Aug 12 11:05:58 dist-test-slave-lgr5 krb5kdc[19141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532758, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:05:58.099622 19170 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:05:58.100962 19170 webserver.cc:460] Webserver started at http://127.18.174.254:38339/ using document root <none> and password file <none>
I20260812 11:05:58.102057 19170 fs_manager.cc:359] Metadata directory not provided
I20260812 11:05:58.102141 19170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:05:58.102577 19170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:05:58.105630 19170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "45a2cb7b837348e28e3f0d9899b8ebba"
format_stamp: "Formatted at 2026-08-12 11:05:58 on dist-test-slave-lgr5"
server_key: "5b49cc34986740ab5eea7b4a86d0d7ec"
server_key_iv: "c697935eacfc93a3f768851e97fdff10"
server_key_version: "encryptionkey@0"
I20260812 11:05:58.106582 19170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "45a2cb7b837348e28e3f0d9899b8ebba"
format_stamp: "Formatted at 2026-08-12 11:05:58 on dist-test-slave-lgr5"
server_key: "5b49cc34986740ab5eea7b4a86d0d7ec"
server_key_iv: "c697935eacfc93a3f768851e97fdff10"
server_key_version: "encryptionkey@0"
I20260812 11:05:58.111876 19170 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260812 11:05:58.115815 19201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:05:58.117566 19170 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:05:58.117820 19170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "45a2cb7b837348e28e3f0d9899b8ebba"
format_stamp: "Formatted at 2026-08-12 11:05:58 on dist-test-slave-lgr5"
server_key: "5b49cc34986740ab5eea7b4a86d0d7ec"
server_key_iv: "c697935eacfc93a3f768851e97fdff10"
server_key_version: "encryptionkey@0"
I20260812 11:05:58.118003 19170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:05:58.133121 19170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:05:58.137014 19170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:05:58.137221 19170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:05:58.149286 19170 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:44729
I20260812 11:05:58.149340 19290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:44729 every 8 connection(s)
I20260812 11:05:58.150799 19170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:05:58.155457 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 19170
I20260812 11:05:58.155637 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:05:58.156476 19293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:05:58.157145 19131 external_mini_cluster.cc:1428] Setting key 7163e61eb24d6a8174c05160acfafdc6
I20260812 11:05:58.167224 19293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba: Bootstrap starting.
I20260812 11:05:58.171402 19293 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba: Neither blocks nor log segments found. Creating new log.
I20260812 11:05:58.172824 19293 log.cc:824] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba: Log is configured to *not* fsync() on all Append() calls
I20260812 11:05:58.175863 19293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba: No bootstrap required, opened a new log
Aug 12 11:05:58 dist-test-slave-lgr5 krb5kdc[19141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:05:58.181610 19293 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45a2cb7b837348e28e3f0d9899b8ebba" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44729 } }
I20260812 11:05:58.181977 19293 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:05:58.182080 19293 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45a2cb7b837348e28e3f0d9899b8ebba, State: Initialized, Role: FOLLOWER
I20260812 11:05:58.182919 19293 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45a2cb7b837348e28e3f0d9899b8ebba" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44729 } }
I20260812 11:05:58.183136 19293 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:05:58.183264 19293 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:05:58.183408 19293 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:05:58.184464 19293 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45a2cb7b837348e28e3f0d9899b8ebba" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44729 } }
I20260812 11:05:58.185163 19293 leader_election.cc:302] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45a2cb7b837348e28e3f0d9899b8ebba; no voters:
I20260812 11:05:58.185592 19293 leader_election.cc:288] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:05:58.185770 19296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:05:58.162455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53986 (local address 127.18.174.254:44729)
0812 11:05:58.162967 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0812 11:05:58.162992 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0812 11:05:58.164177 (+ 1185us) server_negotiation.cc:407] Connection header received
0812 11:05:58.167502 (+ 3325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:05:58.167522 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:05:58.167959 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:05:58.168324 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:05:58.170910 (+ 2586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.172674 (+ 1764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.174485 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.175085 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.175290 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:05:58.179697 (+ 4407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:05:58.179736 (+ 39us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:05:58.179751 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:05:58.179783 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:05:58.181595 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:05:58.182200 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:05:58.182208 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:05:58.182214 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:05:58.182344 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:05:58.182759 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:05:58.182762 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:05:58.182764 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:05:58.183367 (+ 603us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:05:58.183579 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0812 11:05:58.184270 (+ 691us) server_negotiation.cc:299] Negotiation successful
0812 11:05:58.184585 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":132,"threads_started":1}
I20260812 11:05:58.185768 19300 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:05:58.186044 19300 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [term 1 LEADER]: Becoming Leader. State: Replica: 45a2cb7b837348e28e3f0d9899b8ebba, State: Running, Role: LEADER
I20260812 11:05:58.186512 19300 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45a2cb7b837348e28e3f0d9899b8ebba" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44729 } }
I20260812 11:05:58.187325 19293 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:05:58.191475 19303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45a2cb7b837348e28e3f0d9899b8ebba. Latest consensus state: current_term: 1 leader_uuid: "45a2cb7b837348e28e3f0d9899b8ebba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45a2cb7b837348e28e3f0d9899b8ebba" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44729 } } }
I20260812 11:05:58.191639 19303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [sys.catalog]: This master's current role is: LEADER
I20260812 11:05:58.191931 19302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45a2cb7b837348e28e3f0d9899b8ebba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45a2cb7b837348e28e3f0d9899b8ebba" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44729 } } }
I20260812 11:05:58.192178 19302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba [sys.catalog]: This master's current role is: LEADER
W20260812 11:05:58.196393 19332 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:05:58.196537 19332 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:05:58.196627 19333 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:05:58.197574 19333 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:05:58.205765 19333 catalog_manager.cc:1347] Generated new cluster ID: 8062e5d1cda64f2b8809585a3dbe330a
I20260812 11:05:58.205873 19333 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:05:58.223623 19333 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:05:58.225126 19333 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:05:58.231691 19333 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45a2cb7b837348e28e3f0d9899b8ebba: Generated new TSK 0
I20260812 11:05:58.232872 19333 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:05:58.270748 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44729
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:46439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:05:58.392104 19343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:05:58.392490 19343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:05:58.392566 19343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:05:58.396807 19343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:05:58.396881 19343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:05:58.396955 19343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:05:58.402606 19343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44729
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:05:58.403882 19343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:05:58.405081 19343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:05:58.415745 19350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:05:58.415760 19349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:05:58.415746 19352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:05:58.415992 19343 server_base.cc:1034] running on GCE node
I20260812 11:05:58.416639 19343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:05:58.417291 19343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:05:58.418453 19343 hybrid_clock.cc:648] HybridClock initialized: now 1786532758418438 us; error 28 us; skew 500 ppm
Aug 12 11:05:58 dist-test-slave-lgr5 krb5kdc[19141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532758, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:05:58.421362 19343 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:05:58.422338 19343 webserver.cc:460] Webserver started at http://127.18.174.193:46445/ using document root <none> and password file <none>
I20260812 11:05:58.422930 19343 fs_manager.cc:359] Metadata directory not provided
I20260812 11:05:58.422994 19343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:05:58.423173 19343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:05:58.425323 19343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "12184ccadbcc44f3b14d539d68ef4715"
format_stamp: "Formatted at 2026-08-12 11:05:58 on dist-test-slave-lgr5"
server_key: "d8c26f82f4d2f86396ee0fdc171c80a1"
server_key_iv: "b919dc4dbe24f28b2202d4ab45ccaaac"
server_key_version: "encryptionkey@0"
I20260812 11:05:58.425864 19343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "12184ccadbcc44f3b14d539d68ef4715"
format_stamp: "Formatted at 2026-08-12 11:05:58 on dist-test-slave-lgr5"
server_key: "d8c26f82f4d2f86396ee0fdc171c80a1"
server_key_iv: "b919dc4dbe24f28b2202d4ab45ccaaac"
server_key_version: "encryptionkey@0"
I20260812 11:05:58.429713 19343 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:05:58.432188 19367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:05:58.433538 19343 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:05:58.433653 19343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "12184ccadbcc44f3b14d539d68ef4715"
format_stamp: "Formatted at 2026-08-12 11:05:58 on dist-test-slave-lgr5"
server_key: "d8c26f82f4d2f86396ee0fdc171c80a1"
server_key_iv: "b919dc4dbe24f28b2202d4ab45ccaaac"
server_key_version: "encryptionkey@0"
I20260812 11:05:58.433758 19343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:05:58.461871 19343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:05:58.465346 19343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:05:58.465528 19343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:05:58.466241 19343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:05:58.467518 19343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:05:58.467576 19343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:05:58.467618 19343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:05:58.467639 19343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:05:58.477289 19343 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:42817
I20260812 11:05:58.477324 19562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:42817 every 8 connection(s)
I20260812 11:05:58.478437 19343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:05:58.478818 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 19343
I20260812 11:05:58.478933 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:05:58.479245 19131 external_mini_cluster.cc:1428] Setting key f2e845a8def8d249bcc425f63d36aa8b
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
Aug 12 11:05:58 dist-test-slave-lgr5 krb5kdc[19141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532758, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:05:58.498190 19296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:05:58.481127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:58159 (local address 127.18.174.254:44729)
0812 11:05:58.481273 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 11:05:58.481278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:05:58.482360 (+ 1082us) server_negotiation.cc:407] Connection header received
0812 11:05:58.484572 (+ 2212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:05:58.484577 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:05:58.484641 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:05:58.484724 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:05:58.486235 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.487136 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.488552 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.488946 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.489065 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:05:58.494449 (+ 5384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:05:58.494453 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:05:58.494455 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:05:58.494489 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:05:58.495882 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:05:58.496528 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:05:58.496531 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:05:58.496533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:05:58.496616 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:05:58.496977 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:05:58.496980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:05:58.496981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:05:58.497184 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:05:58.497274 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 11:05:58.497856 (+ 582us) server_negotiation.cc:299] Negotiation successful
0812 11:05:58.498012 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:05:58.499086 19567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:05:58.481627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44729 (local address 127.18.174.193:58159)
0812 11:05:58.482167 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0812 11:05:58.482228 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 11:05:58.484233 (+ 2005us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:05:58.485050 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:05:58.485059 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:05:58.485483 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:05:58.486056 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:05:58.486073 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.487278 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.487281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:05:58.488395 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:05:58.488408 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.489098 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.489101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:05:58.489264 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:05:58.489935 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:05:58.489955 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:05:58.494221 (+ 4266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:05:58.496034 (+ 1813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:05:58.496041 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:05:58.496063 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:05:58.496401 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:05:58.496704 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:05:58.496707 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:05:58.496709 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:05:58.496870 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:05:58.497288 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:05:58.497296 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:05:58.497595 (+ 299us) client_negotiation.cc:769] Sending connection context
0812 11:05:58.497778 (+ 183us) client_negotiation.cc:240] Negotiation successful
0812 11:05:58.498162 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":140,"threads_started":1}
I20260812 11:05:58.500494 19564 heartbeater.cc:347] Connected to a master server at 127.18.174.254:44729
I20260812 11:05:58.500811 19564 heartbeater.cc:464] Registering TS with master...
I20260812 11:05:58.501500 19564 heartbeater.cc:511] Master 127.18.174.254:44729 requested a full tablet report, sending...
I20260812 11:05:58.503926 19225 ts_manager.cc:194] Registered new tserver with Master: 12184ccadbcc44f3b14d539d68ef4715 (127.18.174.193:42817)
I20260812 11:05:58.505684 19225 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:58159
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:05:58.510629 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44729
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:46439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:05:58.629138 19571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:05:58.629431 19571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:05:58.629477 19571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:05:58.633538 19571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:05:58.633610 19571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:05:58.633673 19571 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:05:58.639271 19571 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44729
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:05:58.640441 19571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:05:58.641518 19571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:05:58.651636 19586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:05:58.651831 19571 server_base.cc:1034] running on GCE node
W20260812 11:05:58.651612 19587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:05:58.651609 19591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:05:58.652415 19571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:05:58.653122 19571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:05:58.654340 19571 hybrid_clock.cc:648] HybridClock initialized: now 1786532758654315 us; error 38 us; skew 500 ppm
Aug 12 11:05:58 dist-test-slave-lgr5 krb5kdc[19141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532758, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:05:58.657232 19571 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:05:58.658210 19571 webserver.cc:460] Webserver started at http://127.18.174.194:38261/ using document root <none> and password file <none>
I20260812 11:05:58.658798 19571 fs_manager.cc:359] Metadata directory not provided
I20260812 11:05:58.658867 19571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:05:58.659075 19571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:05:58.661268 19571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "9cf872d838c049f4ac9f53b6a186af63"
format_stamp: "Formatted at 2026-08-12 11:05:58 on dist-test-slave-lgr5"
server_key: "bee6ba761d53f4427f29f0810694ea63"
server_key_iv: "1916ad1f43350fab4ce8c5b74e97371d"
server_key_version: "encryptionkey@0"
I20260812 11:05:58.661851 19571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "9cf872d838c049f4ac9f53b6a186af63"
format_stamp: "Formatted at 2026-08-12 11:05:58 on dist-test-slave-lgr5"
server_key: "bee6ba761d53f4427f29f0810694ea63"
server_key_iv: "1916ad1f43350fab4ce8c5b74e97371d"
server_key_version: "encryptionkey@0"
I20260812 11:05:58.665751 19571 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:05:58.668417 19603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:05:58.669720 19571 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:05:58.669845 19571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "9cf872d838c049f4ac9f53b6a186af63"
format_stamp: "Formatted at 2026-08-12 11:05:58 on dist-test-slave-lgr5"
server_key: "bee6ba761d53f4427f29f0810694ea63"
server_key_iv: "1916ad1f43350fab4ce8c5b74e97371d"
server_key_version: "encryptionkey@0"
I20260812 11:05:58.669960 19571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:05:58.686040 19571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:05:58.689422 19571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:05:58.689612 19571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:05:58.690251 19571 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:05:58.691129 19571 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:05:58.691179 19571 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:05:58.691218 19571 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:05:58.691236 19571 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:05:58.700210 19571 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:39419
I20260812 11:05:58.700232 19802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:39419 every 8 connection(s)
I20260812 11:05:58.701208 19571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:05:58.709090 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 19571
I20260812 11:05:58.709192 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:05:58.709455 19131 external_mini_cluster.cc:1428] Setting key 94cc905c3779de685503daab2cbec049
Aug 12 11:05:58 dist-test-slave-lgr5 krb5kdc[19141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532758, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:05:58.715893 19296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:05:58.703184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:34087 (local address 127.18.174.254:44729)
0812 11:05:58.703306 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 11:05:58.703310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:05:58.704219 (+ 909us) server_negotiation.cc:407] Connection header received
0812 11:05:58.705747 (+ 1528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:05:58.705750 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:05:58.705814 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:05:58.705896 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:05:58.707186 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.707720 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.708954 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.709193 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.709303 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:05:58.711961 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:05:58.711964 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:05:58.711967 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:05:58.711994 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:05:58.713608 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:05:58.714185 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:05:58.714189 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:05:58.714191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:05:58.714293 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:05:58.714620 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:05:58.714624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:05:58.714625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:05:58.714868 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:05:58.714968 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 11:05:58.715563 (+ 595us) server_negotiation.cc:299] Negotiation successful
0812 11:05:58.715719 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:05:58.716777 19808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:05:58.703557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44729 (local address 127.18.174.194:34087)
0812 11:05:58.704035 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0812 11:05:58.704104 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 11:05:58.705506 (+ 1402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:05:58.706097 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:05:58.706105 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:05:58.706502 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:05:58.707029 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:05:58.707044 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.707851 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.707855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:05:58.708821 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:05:58.708833 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.709368 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.709373 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:05:58.709568 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:05:58.710170 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:05:58.710188 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:05:58.711785 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:05:58.713757 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:05:58.713764 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:05:58.713779 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:05:58.714078 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:05:58.714380 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:05:58.714382 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:05:58.714383 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:05:58.714530 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:05:58.714961 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:05:58.714966 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:05:58.715248 (+ 282us) client_negotiation.cc:769] Sending connection context
0812 11:05:58.715480 (+ 232us) client_negotiation.cc:240] Negotiation successful
0812 11:05:58.715767 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":126,"threads_started":1}
I20260812 11:05:58.718003 19804 heartbeater.cc:347] Connected to a master server at 127.18.174.254:44729
I20260812 11:05:58.718261 19804 heartbeater.cc:464] Registering TS with master...
I20260812 11:05:58.718807 19804 heartbeater.cc:511] Master 127.18.174.254:44729 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
I20260812 11:05:58.720007 19225 ts_manager.cc:194] Registered new tserver with Master: 9cf872d838c049f4ac9f53b6a186af63 (127.18.174.194:39419)
I20260812 11:05:58.720626 19225 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:34087
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:05:58.739264 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44729
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:46439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:05:58.856654 19813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:05:58.856935 19813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:05:58.856980 19813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:05:58.861045 19813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:05:58.861119 19813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:05:58.861181 19813 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:05:58.866730 19813 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44729
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:05:58.867870 19813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:05:58.868933 19813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:05:58.878948 19834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:05:58.878993 19829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:05:58.879055 19813 server_base.cc:1034] running on GCE node
W20260812 11:05:58.878989 19831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:05:58.879572 19813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:05:58.880288 19813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:05:58.881451 19813 hybrid_clock.cc:648] HybridClock initialized: now 1786532758881428 us; error 35 us; skew 500 ppm
Aug 12 11:05:58 dist-test-slave-lgr5 krb5kdc[19141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532758, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:05:58.884256 19813 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:05:58.885219 19813 webserver.cc:460] Webserver started at http://127.18.174.195:44203/ using document root <none> and password file <none>
I20260812 11:05:58.885782 19813 fs_manager.cc:359] Metadata directory not provided
I20260812 11:05:58.885841 19813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:05:58.886022 19813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:05:58.888211 19813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "a9ba4a6d0ebc4ae8803c2cbfbeb8a40b"
format_stamp: "Formatted at 2026-08-12 11:05:58 on dist-test-slave-lgr5"
server_key: "124b6b242fc814e309e7bab046f198d8"
server_key_iv: "ecabe1dceb9c5aa7b9543bebed2767e1"
server_key_version: "encryptionkey@0"
I20260812 11:05:58.888787 19813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "a9ba4a6d0ebc4ae8803c2cbfbeb8a40b"
format_stamp: "Formatted at 2026-08-12 11:05:58 on dist-test-slave-lgr5"
server_key: "124b6b242fc814e309e7bab046f198d8"
server_key_iv: "ecabe1dceb9c5aa7b9543bebed2767e1"
server_key_version: "encryptionkey@0"
I20260812 11:05:58.893147 19813 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:05:58.895905 19844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:05:58.897215 19813 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:05:58.897322 19813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "a9ba4a6d0ebc4ae8803c2cbfbeb8a40b"
format_stamp: "Formatted at 2026-08-12 11:05:58 on dist-test-slave-lgr5"
server_key: "124b6b242fc814e309e7bab046f198d8"
server_key_iv: "ecabe1dceb9c5aa7b9543bebed2767e1"
server_key_version: "encryptionkey@0"
I20260812 11:05:58.897439 19813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:05:58.907884 19813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:05:58.910750 19813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:05:58.910919 19813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:05:58.911513 19813 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:05:58.912379 19813 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:05:58.912427 19813 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:05:58.912479 19813 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:05:58.912509 19813 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:05:58.921545 19813 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:34159
I20260812 11:05:58.921599 20045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:34159 every 8 connection(s)
I20260812 11:05:58.922500 19813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:05:58.926522 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 19813
I20260812 11:05:58.926630 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:05:58.926872 19131 external_mini_cluster.cc:1428] Setting key 3861410e05e23ec923cd909a6cdbb2f2
Aug 12 11:05:58 dist-test-slave-lgr5 krb5kdc[19141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532758, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:05:58.936614 19296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:05:58.924359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:56479 (local address 127.18.174.254:44729)
0812 11:05:58.924497 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 11:05:58.924501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:05:58.925473 (+ 972us) server_negotiation.cc:407] Connection header received
0812 11:05:58.926840 (+ 1367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:05:58.926844 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:05:58.926908 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:05:58.926985 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:05:58.928577 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.929105 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.930411 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.930637 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.930726 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:05:58.933293 (+ 2567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:05:58.933296 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:05:58.933298 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:05:58.933325 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:05:58.934491 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:05:58.934986 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:05:58.934989 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:05:58.934990 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:05:58.935083 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:05:58.935412 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:05:58.935416 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:05:58.935418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:05:58.935618 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:05:58.935707 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 11:05:58.936292 (+ 585us) server_negotiation.cc:299] Negotiation successful
0812 11:05:58.936430 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:05:58.937551 20051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:05:58.924798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44729 (local address 127.18.174.195:56479)
0812 11:05:58.925303 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0812 11:05:58.925351 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:05:58.926604 (+ 1253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:05:58.927232 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:05:58.927239 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:05:58.927712 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:05:58.928432 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:05:58.928455 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.929227 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.929230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:05:58.930285 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:05:58.930297 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.930781 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.930785 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:05:58.930968 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:05:58.931576 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:05:58.931594 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:05:58.933117 (+ 1523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:05:58.934606 (+ 1489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:05:58.934613 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:05:58.934632 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:05:58.934889 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:05:58.935175 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:05:58.935178 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:05:58.935180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:05:58.935322 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:05:58.935724 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:05:58.935730 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:05:58.936003 (+ 273us) client_negotiation.cc:769] Sending connection context
0812 11:05:58.936220 (+ 217us) client_negotiation.cc:240] Negotiation successful
0812 11:05:58.936588 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":125,"threads_started":1}
I20260812 11:05:58.938758 20046 heartbeater.cc:347] Connected to a master server at 127.18.174.254:44729
I20260812 11:05:58.939006 20046 heartbeater.cc:464] Registering TS with master...
I20260812 11:05:58.939503 20046 heartbeater.cc:511] Master 127.18.174.254:44729 requested a full tablet report, sending...
I20260812 11:05:58.940582 19225 ts_manager.cc:194] Registered new tserver with Master: a9ba4a6d0ebc4ae8803c2cbfbeb8a40b (127.18.174.195:34159)
I20260812 11:05:58.941222 19225 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:56479
I20260812 11:05:58.941628 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:05:58 dist-test-slave-lgr5 krb5kdc[19141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532758, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:05:58 dist-test-slave-lgr5 krb5kdc[19141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532758, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.174.193@KRBTEST.COM
I20260812 11:05:58.969094 20060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:05:58.959520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47678 (local address 127.18.174.193:42817)
0812 11:05:58.959802 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0812 11:05:58.959822 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 11:05:58.959869 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:05:58.960049 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:05:58.960056 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:05:58.960298 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:05:58.960443 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:05:58.961186 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.961991 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.962863 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.963253 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.963355 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:05:58.965757 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:05:58.965767 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:05:58.965783 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:05:58.965812 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:05:58.967232 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:05:58.967669 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:05:58.967675 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:05:58.967676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:05:58.967763 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:05:58.968026 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:05:58.968030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:05:58.968032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:05:58.968328 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:05:58.968551 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0812 11:05:58.968745 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 11:05:58.968905 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":67,"threads_started":1}
W20260812 11:05:58.970229 19413 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47678
Aug 12 11:05:58 dist-test-slave-lgr5 krb5kdc[19141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532758, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:05:58 dist-test-slave-lgr5 krb5kdc[19141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532758, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.193@KRBTEST.COM
I20260812 11:05:58.997334 20060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:05:58.989093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47684 (local address 127.18.174.193:42817)
0812 11:05:58.989255 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 11:05:58.989259 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:05:58.989344 (+ 85us) server_negotiation.cc:407] Connection header received
0812 11:05:58.989527 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:05:58.989531 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:05:58.989586 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:05:58.989657 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:05:58.990404 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.990944 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.991790 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:05:58.992045 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:05:58.992169 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:05:58.994515 (+ 2346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:05:58.994519 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:05:58.994521 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:05:58.994551 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:05:58.995711 (+ 1160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:05:58.996130 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:05:58.996134 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:05:58.996136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:05:58.996225 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:05:58.996480 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:05:58.996484 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:05:58.996486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:05:58.996674 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:05:58.996794 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 11:05:58.997046 (+ 252us) server_negotiation.cc:299] Negotiation successful
0812 11:05:58.997169 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:05:58.998515 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 19343
I20260812 11:05:59.014842 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 19571
I20260812 11:05:59.041625 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 19813
I20260812 11:05:59.062305 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 19170
2026-08-12T11:05:59Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2543 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:05:59 dist-test-slave-lgr5 krb5kdc[20069](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:05:59 dist-test-slave-lgr5 krb5kdc[20069](info): set up 2 sockets
Aug 12 11:05:59 dist-test-slave-lgr5 krb5kdc[20069](info): commencing operation
krb5kdc: starting...
W20260812 11:06:00.276823 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:06:00 dist-test-slave-lgr5 krb5kdc[20069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532760, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:06:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:06:00.402719 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:44597
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:39173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:44597
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:00.517928 20089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:00.518210 20089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:00.518266 20089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:00.522809 20089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:00.522893 20089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:00.522920 20089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:00.522953 20089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:00.522981 20089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:00.528764 20089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:44597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:44597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:00.529839 20089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:00.530834 20089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:00.539529 20099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:00.539568 20089 server_base.cc:1034] running on GCE node
W20260812 11:06:00.539529 20096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:00.539529 20097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:00.540416 20089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:00.541540 20089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:00.542706 20089 hybrid_clock.cc:648] HybridClock initialized: now 1786532760542689 us; error 29 us; skew 500 ppm
Aug 12 11:06:00 dist-test-slave-lgr5 krb5kdc[20069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532760, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:00.545579 20089 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:06:00.546505 20089 webserver.cc:460] Webserver started at http://127.18.174.254:36851/ using document root <none> and password file <none>
I20260812 11:06:00.547047 20089 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:00.547111 20089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:00.547289 20089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:00.549453 20089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "638620803b1b44739369eb0aec5880db"
format_stamp: "Formatted at 2026-08-12 11:06:00 on dist-test-slave-lgr5"
server_key: "00b1a2875e7b3d0075915bd9f35acd3d"
server_key_iv: "a5482bd9b7d500887e9da332d00fbaee"
server_key_version: "encryptionkey@0"
I20260812 11:06:00.550006 20089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "638620803b1b44739369eb0aec5880db"
format_stamp: "Formatted at 2026-08-12 11:06:00 on dist-test-slave-lgr5"
server_key: "00b1a2875e7b3d0075915bd9f35acd3d"
server_key_iv: "a5482bd9b7d500887e9da332d00fbaee"
server_key_version: "encryptionkey@0"
I20260812 11:06:00.553975 20089 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260812 11:06:00.556592 20109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:00.557924 20089 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:00.558045 20089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "638620803b1b44739369eb0aec5880db"
format_stamp: "Formatted at 2026-08-12 11:06:00 on dist-test-slave-lgr5"
server_key: "00b1a2875e7b3d0075915bd9f35acd3d"
server_key_iv: "a5482bd9b7d500887e9da332d00fbaee"
server_key_version: "encryptionkey@0"
I20260812 11:06:00.558153 20089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:00.575304 20089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:00.578472 20089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:00.578667 20089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:00.585925 20089 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:44597
I20260812 11:06:00.585938 20213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:44597 every 8 connection(s)
I20260812 11:06:00.586971 20089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:00.589815 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 20089
I20260812 11:06:00.589943 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:00.590250 19131 external_mini_cluster.cc:1428] Setting key 2a9b88ad7451172a5fbb71f3d970e717
I20260812 11:06:00.590405 20214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:00.598549 20214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db: Bootstrap starting.
Aug 12 11:06:00 dist-test-slave-lgr5 krb5kdc[20069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532760, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:00.601413 20214 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:00.602187 20214 log.cc:824] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:00.604413 20214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db: No bootstrap required, opened a new log
I20260812 11:06:00.605721 20218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:00.591783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45124 (local address 127.18.174.254:44597)
0812 11:06:00.592293 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:00.592316 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:00.592365 (+ 49us) server_negotiation.cc:407] Connection header received
0812 11:06:00.593145 (+ 780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:00.593172 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:00.593657 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:00.594093 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:00.594780 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:00.596359 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:00.597270 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:00.597813 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:00.597946 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:00.600812 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:00.600818 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:00.600835 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:00.600873 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:00.602624 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:00.603108 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:00.603114 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:00.603120 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:00.603245 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:00.603543 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:00.603546 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:00.603547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:00.604004 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:00.604261 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:00.604590 (+ 329us) server_negotiation.cc:299] Negotiation successful
0812 11:06:00.604911 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":150,"threads_started":1}
I20260812 11:06:00.609109 20214 raft_consensus.cc:348] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "638620803b1b44739369eb0aec5880db" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44597 } }
I20260812 11:06:00.609397 20214 raft_consensus.cc:374] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:00.609462 20214 raft_consensus.cc:729] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 638620803b1b44739369eb0aec5880db, State: Initialized, Role: FOLLOWER
I20260812 11:06:00.609905 20214 consensus_queue.cc:260] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "638620803b1b44739369eb0aec5880db" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44597 } }
I20260812 11:06:00.610040 20214 raft_consensus.cc:388] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:00.610108 20214 raft_consensus.cc:482] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:00.610211 20214 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:00.611241 20214 raft_consensus.cc:504] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "638620803b1b44739369eb0aec5880db" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44597 } }
I20260812 11:06:00.611605 20214 leader_election.cc:302] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 638620803b1b44739369eb0aec5880db; no voters:
I20260812 11:06:00.611971 20214 leader_election.cc:288] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:00.612120 20223 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:00.612345 20223 raft_consensus.cc:686] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [term 1 LEADER]: Becoming Leader. State: Replica: 638620803b1b44739369eb0aec5880db, State: Running, Role: LEADER
I20260812 11:06:00.612751 20223 consensus_queue.cc:237] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "638620803b1b44739369eb0aec5880db" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44597 } }
I20260812 11:06:00.613451 20214 sys_catalog.cc:564] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:00.614673 20225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 638620803b1b44739369eb0aec5880db. Latest consensus state: current_term: 1 leader_uuid: "638620803b1b44739369eb0aec5880db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "638620803b1b44739369eb0aec5880db" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44597 } } }
I20260812 11:06:00.614679 20224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "638620803b1b44739369eb0aec5880db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "638620803b1b44739369eb0aec5880db" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44597 } } }
I20260812 11:06:00.614822 20225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:00.614822 20224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:00.615255 20238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:00.618813 20238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:00.625340 20238 catalog_manager.cc:1347] Generated new cluster ID: 881b66ca78304b78a266665148fe9edf
I20260812 11:06:00.625530 20238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:00.648011 20238 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:00.649152 20238 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:00.654453 20238 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 638620803b1b44739369eb0aec5880db: Generated new TSK 0
I20260812 11:06:00.655207 20238 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:06:00.691088 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44597
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:39173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:00.808928 20254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:00.809289 20254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:00.809358 20254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:00.813570 20254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:00.813647 20254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:00.813732 20254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:00.819500 20254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44597
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:00.820776 20254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:00.821878 20254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:00.832370 20271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:00.832425 20268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:00.832331 20266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:00.832592 20254 server_base.cc:1034] running on GCE node
I20260812 11:06:00.833024 20254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:00.833710 20254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:00.834867 20254 hybrid_clock.cc:648] HybridClock initialized: now 1786532760834828 us; error 54 us; skew 500 ppm
Aug 12 11:06:00 dist-test-slave-lgr5 krb5kdc[20069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532760, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:00.837721 20254 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:06:00.838683 20254 webserver.cc:460] Webserver started at http://127.18.174.193:44579/ using document root <none> and password file <none>
I20260812 11:06:00.839234 20254 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:00.839295 20254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:00.839478 20254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:00.841660 20254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "2882210ce8ea449296c3eecd64189038"
format_stamp: "Formatted at 2026-08-12 11:06:00 on dist-test-slave-lgr5"
server_key: "7214eb280d14f8b10a503e7557151e68"
server_key_iv: "fe77a0ec6bc411338c48dfb5c9ddb8f4"
server_key_version: "encryptionkey@0"
I20260812 11:06:00.842242 20254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "2882210ce8ea449296c3eecd64189038"
format_stamp: "Formatted at 2026-08-12 11:06:00 on dist-test-slave-lgr5"
server_key: "7214eb280d14f8b10a503e7557151e68"
server_key_iv: "fe77a0ec6bc411338c48dfb5c9ddb8f4"
server_key_version: "encryptionkey@0"
I20260812 11:06:00.846220 20254 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:06:00.848869 20281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:00.850157 20254 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:00.850273 20254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "2882210ce8ea449296c3eecd64189038"
format_stamp: "Formatted at 2026-08-12 11:06:00 on dist-test-slave-lgr5"
server_key: "7214eb280d14f8b10a503e7557151e68"
server_key_iv: "fe77a0ec6bc411338c48dfb5c9ddb8f4"
server_key_version: "encryptionkey@0"
I20260812 11:06:00.850370 20254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:00.864069 20254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:00.867142 20254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:00.867336 20254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:00.867966 20254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:00.868903 20254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:00.868952 20254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:00.868996 20254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:00.869026 20254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:00.877615 20254 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:38153
I20260812 11:06:00.877640 20471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:38153 every 8 connection(s)
I20260812 11:06:00.878579 20254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
Aug 12 11:06:00 dist-test-slave-lgr5 krb5kdc[20069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532760, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:00.888845 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 20254
I20260812 11:06:00.888986 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:06:00.889278 19131 external_mini_cluster.cc:1428] Setting key 583ec102273ed29b207a145f7d3f3442
I20260812 11:06:00.892059 20218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:00.880529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:39017 (local address 127.18.174.254:44597)
0812 11:06:00.880670 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:00.880674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:00.881558 (+ 884us) server_negotiation.cc:407] Connection header received
0812 11:06:00.882427 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:00.882430 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:00.882490 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:00.882566 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:00.883779 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:00.884369 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:00.885498 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:00.885724 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:00.885793 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:00.888333 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:00.888337 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:00.888339 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:00.888367 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:00.889846 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:00.890392 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:00.890396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:00.890398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:00.890491 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:00.890842 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:00.890845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:00.890847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:00.891055 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:00.891134 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:00.891797 (+ 663us) server_negotiation.cc:299] Negotiation successful
0812 11:06:00.891916 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:06:00.893260 20475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:00.880908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44597 (local address 127.18.174.193:39017)
0812 11:06:00.881386 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:00.881431 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:00.882217 (+ 786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:00.882771 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:00.882779 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:00.883153 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:00.883653 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:00.883668 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:00.884479 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:00.884482 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:00.885381 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:00.885392 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:00.885841 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:00.885843 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:00.886015 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:00.886629 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:00.886648 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:00.888155 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:00.889981 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:00.889989 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:00.890007 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:00.890288 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:00.890582 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:00.890585 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:00.890587 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:00.890750 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:00.891165 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:00.891172 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:00.891547 (+ 375us) client_negotiation.cc:769] Sending connection context
0812 11:06:00.891777 (+ 230us) client_negotiation.cc:240] Negotiation successful
0812 11:06:00.892203 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":112,"threads_started":1}
I20260812 11:06:00.894589 20472 heartbeater.cc:347] Connected to a master server at 127.18.174.254:44597
I20260812 11:06:00.894845 20472 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:00.895395 20472 heartbeater.cc:511] Master 127.18.174.254:44597 requested a full tablet report, sending...
I20260812 11:06:00.897333 20153 ts_manager.cc:194] Registered new tserver with Master: 2882210ce8ea449296c3eecd64189038 (127.18.174.193:38153)
I20260812 11:06:00.899015 20153 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:39017
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:06:00.919284 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44597
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:39173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:01.035756 20479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:01.036028 20479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:01.036073 20479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:01.040124 20479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:01.040194 20479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:01.040253 20479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:06:01.045730 20479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44597
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:01.046914 20479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:01.047991 20479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:01.058158 20486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:01.058208 20488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:01.058161 20490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:01.058251 20479 server_base.cc:1034] running on GCE node
I20260812 11:06:01.058902 20479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:01.059613 20479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:01.060760 20479 hybrid_clock.cc:648] HybridClock initialized: now 1786532761060728 us; error 46 us; skew 500 ppm
Aug 12 11:06:01 dist-test-slave-lgr5 krb5kdc[20069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532761, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:01.063601 20479 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:06:01.064628 20479 webserver.cc:460] Webserver started at http://127.18.174.194:39673/ using document root <none> and password file <none>
I20260812 11:06:01.065215 20479 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:01.065285 20479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:01.065521 20479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:01.067696 20479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "61a50d7c49734fc19b20d681b0d78277"
format_stamp: "Formatted at 2026-08-12 11:06:01 on dist-test-slave-lgr5"
server_key: "57e14bb61e2e7717fcb27701a9ff567a"
server_key_iv: "f296d06772d23f34c4e18f73091a79bb"
server_key_version: "encryptionkey@0"
I20260812 11:06:01.068351 20479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "61a50d7c49734fc19b20d681b0d78277"
format_stamp: "Formatted at 2026-08-12 11:06:01 on dist-test-slave-lgr5"
server_key: "57e14bb61e2e7717fcb27701a9ff567a"
server_key_iv: "f296d06772d23f34c4e18f73091a79bb"
server_key_version: "encryptionkey@0"
I20260812 11:06:01.072216 20479 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:06:01.074769 20502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:01.076171 20479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:01.076293 20479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "61a50d7c49734fc19b20d681b0d78277"
format_stamp: "Formatted at 2026-08-12 11:06:01 on dist-test-slave-lgr5"
server_key: "57e14bb61e2e7717fcb27701a9ff567a"
server_key_iv: "f296d06772d23f34c4e18f73091a79bb"
server_key_version: "encryptionkey@0"
I20260812 11:06:01.076402 20479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:01.096294 20479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:01.099418 20479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:01.099623 20479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:01.100294 20479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:01.101222 20479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:01.101274 20479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:01.101330 20479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:01.101356 20479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:01.110319 20479 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:35313
I20260812 11:06:01.110344 20690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:35313 every 8 connection(s)
I20260812 11:06:01.111266 20479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:06:01.116847 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 20479
I20260812 11:06:01.116938 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:06:01.117177 19131 external_mini_cluster.cc:1428] Setting key 7dcb619c34045d3dd6985d2b83d57c50
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
Aug 12 11:06:01 dist-test-slave-lgr5 krb5kdc[20069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532761, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:01.134775 20218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.113215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:57779 (local address 127.18.174.254:44597)
0812 11:06:01.113350 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:01.113353 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:01.114211 (+ 858us) server_negotiation.cc:407] Connection header received
0812 11:06:01.115213 (+ 1002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:01.115217 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:01.115274 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:01.115348 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:01.116659 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.117215 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.118489 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.118784 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.118899 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.130761 (+ 11862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:01.130767 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:01.130770 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:01.130810 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:01.132291 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:01.132979 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:01.132982 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:01.132983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:01.133071 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:01.133489 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:01.133491 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:01.133492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:01.133691 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:01.133767 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:01.134507 (+ 740us) server_negotiation.cc:299] Negotiation successful
0812 11:06:01.134631 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:06:01.136196 20696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.113590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44597 (local address 127.18.174.194:57779)
0812 11:06:01.114062 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:01.114106 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:01.115011 (+ 905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:01.115551 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:01.115560 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:01.115949 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:01.116516 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:01.116531 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.117339 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.117342 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:01.118366 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:01.118379 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.118930 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.118933 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:01.119105 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.127548 (+ 8443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:01.127578 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:01.130496 (+ 2918us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:01.132441 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:01.132450 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:01.132472 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:01.132874 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:01.133165 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:01.133169 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:01.133171 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:01.133391 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:01.133801 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:01.133810 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:01.134214 (+ 404us) client_negotiation.cc:769] Sending connection context
0812 11:06:01.134462 (+ 248us) client_negotiation.cc:240] Negotiation successful
0812 11:06:01.134901 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":112,"threads_started":1}
I20260812 11:06:01.137575 20691 heartbeater.cc:347] Connected to a master server at 127.18.174.254:44597
I20260812 11:06:01.137843 20691 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:01.138444 20691 heartbeater.cc:511] Master 127.18.174.254:44597 requested a full tablet report, sending...
I20260812 11:06:01.139784 20153 ts_manager.cc:194] Registered new tserver with Master: 61a50d7c49734fc19b20d681b0d78277 (127.18.174.194:35313)
I20260812 11:06:01.140499 20153 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:57779
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:06:01.147150 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44597
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:39173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:01.265218 20699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:01.265504 20699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:01.265549 20699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:01.269676 20699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:01.269749 20699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:01.269811 20699 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:06:01.275399 20699 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44597
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:01.276592 20699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:01.277686 20699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:01.287799 20708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:01.287803 20706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:01.287894 20699 server_base.cc:1034] running on GCE node
W20260812 11:06:01.287803 20710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:01.288514 20699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:01.289202 20699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:01.290364 20699 hybrid_clock.cc:648] HybridClock initialized: now 1786532761290336 us; error 41 us; skew 500 ppm
Aug 12 11:06:01 dist-test-slave-lgr5 krb5kdc[20069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532761, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:01.293177 20699 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:06:01.294188 20699 webserver.cc:460] Webserver started at http://127.18.174.195:42769/ using document root <none> and password file <none>
I20260812 11:06:01.294775 20699 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:01.294847 20699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:01.295077 20699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:01.297312 20699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "48052381c66b490ab8f8fcfdc92c6558"
format_stamp: "Formatted at 2026-08-12 11:06:01 on dist-test-slave-lgr5"
server_key: "4847ebc7b7ad506167d6ab9bdcf145f6"
server_key_iv: "8de4709c5cd062ee202a89650eccc59e"
server_key_version: "encryptionkey@0"
I20260812 11:06:01.297894 20699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "48052381c66b490ab8f8fcfdc92c6558"
format_stamp: "Formatted at 2026-08-12 11:06:01 on dist-test-slave-lgr5"
server_key: "4847ebc7b7ad506167d6ab9bdcf145f6"
server_key_iv: "8de4709c5cd062ee202a89650eccc59e"
server_key_version: "encryptionkey@0"
I20260812 11:06:01.301913 20699 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:06:01.304553 20728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:01.305845 20699 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:01.305994 20699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "48052381c66b490ab8f8fcfdc92c6558"
format_stamp: "Formatted at 2026-08-12 11:06:01 on dist-test-slave-lgr5"
server_key: "4847ebc7b7ad506167d6ab9bdcf145f6"
server_key_iv: "8de4709c5cd062ee202a89650eccc59e"
server_key_version: "encryptionkey@0"
I20260812 11:06:01.306106 20699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:01.333139 20699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:01.336238 20699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:01.336432 20699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:01.337054 20699 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:01.337916 20699 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:01.337965 20699 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:01.338029 20699 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:01.338053 20699 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:01.346936 20699 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:46047
I20260812 11:06:01.346961 20922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:46047 every 8 connection(s)
I20260812 11:06:01.347908 20699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:06:01.355213 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 20699
I20260812 11:06:01.355357 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:06:01.355645 19131 external_mini_cluster.cc:1428] Setting key 626dc1ed9d877a4b4dfc81b1f6db6fdc
Aug 12 11:06:01 dist-test-slave-lgr5 krb5kdc[20069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532761, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:01.361940 20218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.349947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:42971 (local address 127.18.174.254:44597)
0812 11:06:01.350091 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:01.350095 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:01.351316 (+ 1221us) server_negotiation.cc:407] Connection header received
0812 11:06:01.352314 (+ 998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:01.352318 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:01.352373 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:01.352435 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:01.353741 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.354313 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.355755 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.355995 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.356134 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.358778 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:01.358782 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:01.358784 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:01.358812 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:01.359983 (+ 1171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:01.360509 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:01.360512 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:01.360513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:01.360590 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:01.360866 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:01.360868 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:01.360869 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:01.361067 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:01.361149 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:01.361676 (+ 527us) server_negotiation.cc:299] Negotiation successful
0812 11:06:01.361814 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:06:01.362857 20925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.350370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44597 (local address 127.18.174.195:42971)
0812 11:06:01.351141 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:01.351189 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:01.352025 (+ 836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:01.352596 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:01.352603 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:01.353033 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:01.353617 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:01.353633 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.354427 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.354430 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:01.355598 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:01.355612 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.356209 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.356214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:01.356425 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.356970 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:01.356988 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:01.358614 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:01.360120 (+ 1506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:01.360128 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:01.360146 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:01.360418 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:01.360658 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:01.360661 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:01.360662 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:01.360799 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:01.361146 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:01.361151 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:01.361408 (+ 257us) client_negotiation.cc:769] Sending connection context
0812 11:06:01.361598 (+ 190us) client_negotiation.cc:240] Negotiation successful
0812 11:06:01.361913 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":136,"threads_started":1}
I20260812 11:06:01.364009 20923 heartbeater.cc:347] Connected to a master server at 127.18.174.254:44597
I20260812 11:06:01.364297 20923 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:01.364837 20923 heartbeater.cc:511] Master 127.18.174.254:44597 requested a full tablet report, sending...
I20260812 11:06:01.365940 20153 ts_manager.cc:194] Registered new tserver with Master: 48052381c66b490ab8f8fcfdc92c6558 (127.18.174.195:46047)
I20260812 11:06:01.366528 20153 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:42971
I20260812 11:06:01.369671 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:06:01.381189 20218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.374221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45140 (local address 127.18.174.254:44597)
0812 11:06:01.374344 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:01.374348 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:01.374509 (+ 161us) server_negotiation.cc:407] Connection header received
0812 11:06:01.374624 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:01.374626 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:01.374671 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:01.374745 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:01.375437 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.375952 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.376793 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.377017 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.377095 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.378365 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:01.378368 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:01.378370 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:01.378389 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:01.379532 (+ 1143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:01.379959 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:01.379962 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:01.379963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:01.380054 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:01.380311 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:01.380314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:01.380316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:01.380603 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:01.380725 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:01.380922 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 11:06:01.381027 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:06:01.387549 20153 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:06:01.391057 20153 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:01.408159 20954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.403279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42002 (local address 127.18.174.195:46047)
0812 11:06:01.403775 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:01.403785 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:01.403802 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:06:01.403876 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:01.403880 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:01.404119 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:01.404268 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:01.404446 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.405206 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.406836 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.407409 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.407528 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.407752 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:01.407852 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 11:06:01.407954 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":110,"threads_started":1}
I20260812 11:06:01.408159 20948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.402871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:46047 (local address 127.0.0.1:42002)
0812 11:06:01.403587 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:01.403599 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:01.403682 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:01.404250 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:01.404253 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:01.404272 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:01.404355 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:01.404362 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.405321 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.405323 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:01.406716 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:01.406724 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.407537 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.407541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:01.407655 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.407696 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 11:06:01.407820 (+ 124us) client_negotiation.cc:240] Negotiation successful
0812 11:06:01.407954 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"mutex_wait_us":239,"thread_start_us":81,"threads_started":1}
I20260812 11:06:01.408349 20944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.401959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:38153 (local address 127.0.0.1:45836)
0812 11:06:01.402546 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:01.402598 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:01.402746 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:01.403281 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:01.403287 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:01.403314 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:01.403494 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:01.403502 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.405186 (+ 1684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.405189 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:01.406498 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:01.406508 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.407822 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.407826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:01.407966 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.408017 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 11:06:01.408109 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 11:06:01.408205 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":85,"thread_start_us":105,"threads_started":1}
I20260812 11:06:01.408427 20949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.402250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42546 (local address 127.18.174.194:35313)
0812 11:06:01.403041 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:01.403053 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:01.403447 (+ 394us) server_negotiation.cc:407] Connection header received
0812 11:06:01.403531 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:01.403536 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:01.403727 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:01.403883 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:01.404070 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.405161 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.406790 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.407583 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.407689 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.407786 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:01.408202 (+ 416us) server_negotiation.cc:299] Negotiation successful
0812 11:06:01.408296 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":138,"threads_started":1}
I20260812 11:06:01.408749 20952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.402096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:35313 (local address 127.0.0.1:42546)
0812 11:06:01.403290 (+ 1194us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:01.403303 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:01.403405 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:01.403858 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:01.403861 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:01.403878 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:01.403978 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:01.403984 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.405289 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.405293 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:01.406649 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:01.406661 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.407835 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.407838 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:01.407944 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.408015 (+ 71us) client_negotiation.cc:769] Sending connection context
0812 11:06:01.408108 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 11:06:01.408625 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1132,"mutex_wait_us":490,"thread_start_us":104,"threads_started":1}
I20260812 11:06:01.408802 20947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.402107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45836 (local address 127.18.174.193:38153)
0812 11:06:01.402773 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:01.402781 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:01.402809 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:06:01.402890 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:01.402895 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:01.403116 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:01.403654 (+ 538us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:01.403797 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.405062 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.406631 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.407460 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.407589 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.407752 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:01.408543 (+ 791us) server_negotiation.cc:299] Negotiation successful
0812 11:06:01.408640 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":64,"threads_started":1}
I20260812 11:06:01.412153 20580 tablet_service.cc:1467] Processing CreateTablet for tablet ca27a60280084ee4a84f9c17677cbd7c (DEFAULT_TABLE table=test-table [id=e018c4ef4a454494b0fd6b468a58c254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:01.413364 20810 tablet_service.cc:1467] Processing CreateTablet for tablet ca27a60280084ee4a84f9c17677cbd7c (DEFAULT_TABLE table=test-table [id=e018c4ef4a454494b0fd6b468a58c254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:01.413743 20580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca27a60280084ee4a84f9c17677cbd7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:01.414361 20810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca27a60280084ee4a84f9c17677cbd7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:01.414263 20360 tablet_service.cc:1467] Processing CreateTablet for tablet ca27a60280084ee4a84f9c17677cbd7c (DEFAULT_TABLE table=test-table [id=e018c4ef4a454494b0fd6b468a58c254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:01.415284 20360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca27a60280084ee4a84f9c17677cbd7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:01.421216 20955 tablet_bootstrap.cc:492] T ca27a60280084ee4a84f9c17677cbd7c P 48052381c66b490ab8f8fcfdc92c6558: Bootstrap starting.
I20260812 11:06:01.422322 20959 tablet_bootstrap.cc:492] T ca27a60280084ee4a84f9c17677cbd7c P 2882210ce8ea449296c3eecd64189038: Bootstrap starting.
I20260812 11:06:01.422909 20958 tablet_bootstrap.cc:492] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277: Bootstrap starting.
I20260812 11:06:01.423589 20955 tablet_bootstrap.cc:654] T ca27a60280084ee4a84f9c17677cbd7c P 48052381c66b490ab8f8fcfdc92c6558: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:01.424654 20959 tablet_bootstrap.cc:654] T ca27a60280084ee4a84f9c17677cbd7c P 2882210ce8ea449296c3eecd64189038: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:01.425491 20958 tablet_bootstrap.cc:654] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:01.425530 20955 log.cc:824] T ca27a60280084ee4a84f9c17677cbd7c P 48052381c66b490ab8f8fcfdc92c6558: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:01.425606 20959 log.cc:824] T ca27a60280084ee4a84f9c17677cbd7c P 2882210ce8ea449296c3eecd64189038: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:01.426236 20958 log.cc:824] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:01.427491 20955 tablet_bootstrap.cc:492] T ca27a60280084ee4a84f9c17677cbd7c P 48052381c66b490ab8f8fcfdc92c6558: No bootstrap required, opened a new log
I20260812 11:06:01.427678 20955 ts_tablet_manager.cc:1397] T ca27a60280084ee4a84f9c17677cbd7c P 48052381c66b490ab8f8fcfdc92c6558: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 11:06:01.427884 20958 tablet_bootstrap.cc:492] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277: No bootstrap required, opened a new log
I20260812 11:06:01.428053 20958 ts_tablet_manager.cc:1397] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:06:01.430751 20955 raft_consensus.cc:348] T ca27a60280084ee4a84f9c17677cbd7c P 48052381c66b490ab8f8fcfdc92c6558 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2882210ce8ea449296c3eecd64189038" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38153 } } peers { permanent_uuid: "61a50d7c49734fc19b20d681b0d78277" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35313 } } peers { permanent_uuid: "48052381c66b490ab8f8fcfdc92c6558" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46047 } }
I20260812 11:06:01.431027 20955 raft_consensus.cc:374] T ca27a60280084ee4a84f9c17677cbd7c P 48052381c66b490ab8f8fcfdc92c6558 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:01.431095 20955 raft_consensus.cc:729] T ca27a60280084ee4a84f9c17677cbd7c P 48052381c66b490ab8f8fcfdc92c6558 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48052381c66b490ab8f8fcfdc92c6558, State: Initialized, Role: FOLLOWER
I20260812 11:06:01.431002 20958 raft_consensus.cc:348] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2882210ce8ea449296c3eecd64189038" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38153 } } peers { permanent_uuid: "61a50d7c49734fc19b20d681b0d78277" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35313 } } peers { permanent_uuid: "48052381c66b490ab8f8fcfdc92c6558" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46047 } }
I20260812 11:06:01.431250 20958 raft_consensus.cc:374] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:01.431295 20958 raft_consensus.cc:729] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61a50d7c49734fc19b20d681b0d78277, State: Initialized, Role: FOLLOWER
I20260812 11:06:01.431595 20955 consensus_queue.cc:260] T ca27a60280084ee4a84f9c17677cbd7c P 48052381c66b490ab8f8fcfdc92c6558 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2882210ce8ea449296c3eecd64189038" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38153 } } peers { permanent_uuid: "61a50d7c49734fc19b20d681b0d78277" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35313 } } peers { permanent_uuid: "48052381c66b490ab8f8fcfdc92c6558" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46047 } }
I20260812 11:06:01.431694 20958 consensus_queue.cc:260] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2882210ce8ea449296c3eecd64189038" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38153 } } peers { permanent_uuid: "61a50d7c49734fc19b20d681b0d78277" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35313 } } peers { permanent_uuid: "48052381c66b490ab8f8fcfdc92c6558" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46047 } }
I20260812 11:06:01.432408 20691 heartbeater.cc:503] Master 127.18.174.254:44597 was elected leader, sending a full tablet report...
I20260812 11:06:01.432408 20923 heartbeater.cc:503] Master 127.18.174.254:44597 was elected leader, sending a full tablet report...
I20260812 11:06:01.432675 20958 ts_tablet_manager.cc:1428] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:06:01.435825 20955 ts_tablet_manager.cc:1428] T ca27a60280084ee4a84f9c17677cbd7c P 48052381c66b490ab8f8fcfdc92c6558: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260812 11:06:01.437467 20959 tablet_bootstrap.cc:492] T ca27a60280084ee4a84f9c17677cbd7c P 2882210ce8ea449296c3eecd64189038: No bootstrap required, opened a new log
I20260812 11:06:01.437790 20959 ts_tablet_manager.cc:1397] T ca27a60280084ee4a84f9c17677cbd7c P 2882210ce8ea449296c3eecd64189038: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.000s
I20260812 11:06:01.441829 20959 raft_consensus.cc:348] T ca27a60280084ee4a84f9c17677cbd7c P 2882210ce8ea449296c3eecd64189038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2882210ce8ea449296c3eecd64189038" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38153 } } peers { permanent_uuid: "61a50d7c49734fc19b20d681b0d78277" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35313 } } peers { permanent_uuid: "48052381c66b490ab8f8fcfdc92c6558" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46047 } }
I20260812 11:06:01.442106 20959 raft_consensus.cc:374] T ca27a60280084ee4a84f9c17677cbd7c P 2882210ce8ea449296c3eecd64189038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:01.442170 20959 raft_consensus.cc:729] T ca27a60280084ee4a84f9c17677cbd7c P 2882210ce8ea449296c3eecd64189038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2882210ce8ea449296c3eecd64189038, State: Initialized, Role: FOLLOWER
I20260812 11:06:01.442617 20959 consensus_queue.cc:260] T ca27a60280084ee4a84f9c17677cbd7c P 2882210ce8ea449296c3eecd64189038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2882210ce8ea449296c3eecd64189038" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38153 } } peers { permanent_uuid: "61a50d7c49734fc19b20d681b0d78277" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35313 } } peers { permanent_uuid: "48052381c66b490ab8f8fcfdc92c6558" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46047 } }
I20260812 11:06:01.443312 20472 heartbeater.cc:503] Master 127.18.174.254:44597 was elected leader, sending a full tablet report...
I20260812 11:06:01.443573 20959 ts_tablet_manager.cc:1428] T ca27a60280084ee4a84f9c17677cbd7c P 2882210ce8ea449296c3eecd64189038: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260812 11:06:01.599082 20924 tablet.cc:2369] T ca27a60280084ee4a84f9c17677cbd7c P 48052381c66b490ab8f8fcfdc92c6558: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:06:01.599625 20966 raft_consensus.cc:482] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:01.599826 20966 raft_consensus.cc:504] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2882210ce8ea449296c3eecd64189038" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38153 } } peers { permanent_uuid: "61a50d7c49734fc19b20d681b0d78277" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35313 } } peers { permanent_uuid: "48052381c66b490ab8f8fcfdc92c6558" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46047 } }
I20260812 11:06:01.600997 20966 leader_election.cc:288] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2882210ce8ea449296c3eecd64189038 (127.18.174.193:38153), 48052381c66b490ab8f8fcfdc92c6558 (127.18.174.195:46047)
I20260812 11:06:01.604671 20947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.601358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:55559 (local address 127.18.174.193:38153)
0812 11:06:01.601526 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:01.601531 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:01.601548 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:06:01.601693 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:01.601696 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:01.601738 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:01.601802 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:01.602073 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.602586 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.603660 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.604129 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.604242 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.604301 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:01.604466 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 11:06:01.604541 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 11:06:01.604682 20954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.601384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:38987 (local address 127.18.174.195:46047)
0812 11:06:01.601644 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:01.601648 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:01.601664 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:06:01.601808 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:01.601812 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:01.601852 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:01.601913 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:01.602184 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.602685 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.603721 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.604163 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.604267 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.604320 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:01.604494 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 11:06:01.604560 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177}
I20260812 11:06:01.604671 20696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.601241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:38153 (local address 127.18.174.194:55559)
0812 11:06:01.601445 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:01.601462 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:01.601578 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:01.601827 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:01.601829 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:01.601847 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:01.601962 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:01.601968 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.602701 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.602704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:01.603530 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:01.603539 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.604242 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.604246 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:01.604353 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.604372 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 11:06:01.604438 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 11:06:01.604528 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":21}
I20260812 11:06:01.604696 20972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.601279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:46047 (local address 127.18.174.194:38987)
0812 11:06:01.601579 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:01.601594 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:01.601702 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:01.601934 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:01.601937 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:01.601953 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:01.602080 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:01.602085 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.602790 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.602794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:01.603595 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:01.603604 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.604276 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.604279 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:01.604377 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.604396 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 11:06:01.604461 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 11:06:01.604546 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":1,"thread_start_us":99,"threads_started":1}
I20260812 11:06:01.605536 20395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca27a60280084ee4a84f9c17677cbd7c" candidate_uuid: "61a50d7c49734fc19b20d681b0d78277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2882210ce8ea449296c3eecd64189038" is_pre_election: true
I20260812 11:06:01.605974 20395 raft_consensus.cc:2454] T ca27a60280084ee4a84f9c17677cbd7c P 2882210ce8ea449296c3eecd64189038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61a50d7c49734fc19b20d681b0d78277 in term 0.
I20260812 11:06:01.606583 20507 leader_election.cc:302] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2882210ce8ea449296c3eecd64189038, 61a50d7c49734fc19b20d681b0d78277; no voters:
I20260812 11:06:01.606880 20966 raft_consensus.cc:2781] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:01.606989 20966 raft_consensus.cc:482] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:01.607043 20966 raft_consensus.cc:3037] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:01.607592 20845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca27a60280084ee4a84f9c17677cbd7c" candidate_uuid: "61a50d7c49734fc19b20d681b0d78277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48052381c66b490ab8f8fcfdc92c6558" is_pre_election: true
I20260812 11:06:01.607918 20845 raft_consensus.cc:2454] T ca27a60280084ee4a84f9c17677cbd7c P 48052381c66b490ab8f8fcfdc92c6558 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61a50d7c49734fc19b20d681b0d78277 in term 0.
I20260812 11:06:01.608276 20966 raft_consensus.cc:504] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2882210ce8ea449296c3eecd64189038" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38153 } } peers { permanent_uuid: "61a50d7c49734fc19b20d681b0d78277" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35313 } } peers { permanent_uuid: "48052381c66b490ab8f8fcfdc92c6558" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46047 } }
I20260812 11:06:01.608644 20966 leader_election.cc:288] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [CANDIDATE]: Term 1 election: Requested vote from peers 2882210ce8ea449296c3eecd64189038 (127.18.174.193:38153), 48052381c66b490ab8f8fcfdc92c6558 (127.18.174.195:46047)
I20260812 11:06:01.609059 20395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca27a60280084ee4a84f9c17677cbd7c" candidate_uuid: "61a50d7c49734fc19b20d681b0d78277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2882210ce8ea449296c3eecd64189038"
I20260812 11:06:01.609058 20845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca27a60280084ee4a84f9c17677cbd7c" candidate_uuid: "61a50d7c49734fc19b20d681b0d78277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48052381c66b490ab8f8fcfdc92c6558"
I20260812 11:06:01.609200 20395 raft_consensus.cc:3037] T ca27a60280084ee4a84f9c17677cbd7c P 2882210ce8ea449296c3eecd64189038 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:01.609200 20845 raft_consensus.cc:3037] T ca27a60280084ee4a84f9c17677cbd7c P 48052381c66b490ab8f8fcfdc92c6558 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:01.610601 20395 raft_consensus.cc:2454] T ca27a60280084ee4a84f9c17677cbd7c P 2882210ce8ea449296c3eecd64189038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61a50d7c49734fc19b20d681b0d78277 in term 1.
I20260812 11:06:01.610601 20845 raft_consensus.cc:2454] T ca27a60280084ee4a84f9c17677cbd7c P 48052381c66b490ab8f8fcfdc92c6558 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61a50d7c49734fc19b20d681b0d78277 in term 1.
I20260812 11:06:01.610985 20507 leader_election.cc:302] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2882210ce8ea449296c3eecd64189038, 61a50d7c49734fc19b20d681b0d78277; no voters:
I20260812 11:06:01.611213 20966 raft_consensus.cc:2781] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:01.611479 20966 raft_consensus.cc:686] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [term 1 LEADER]: Becoming Leader. State: Replica: 61a50d7c49734fc19b20d681b0d78277, State: Running, Role: LEADER
I20260812 11:06:01.611852 20966 consensus_queue.cc:237] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2882210ce8ea449296c3eecd64189038" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38153 } } peers { permanent_uuid: "61a50d7c49734fc19b20d681b0d78277" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35313 } } peers { permanent_uuid: "48052381c66b490ab8f8fcfdc92c6558" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46047 } }
W20260812 11:06:01.612351 20695 tablet.cc:2369] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:06:01.615536 20153 catalog_manager.cc:5495] T ca27a60280084ee4a84f9c17677cbd7c P 61a50d7c49734fc19b20d681b0d78277 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61a50d7c49734fc19b20d681b0d78277 (127.18.174.194). New cstate: current_term: 1 leader_uuid: "61a50d7c49734fc19b20d681b0d78277" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2882210ce8ea449296c3eecd64189038" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61a50d7c49734fc19b20d681b0d78277" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48052381c66b490ab8f8fcfdc92c6558" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46047 } health_report { overall_health: UNKNOWN } } }
W20260812 11:06:01.629977 20473 tablet.cc:2369] T ca27a60280084ee4a84f9c17677cbd7c P 2882210ce8ea449296c3eecd64189038: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 11:06:01 dist-test-slave-lgr5 krb5kdc[20069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532760, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.193@KRBTEST.COM
I20260812 11:06:01.653252 20947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.644615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45842 (local address 127.18.174.193:38153)
0812 11:06:01.644762 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:01.644767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:01.644911 (+ 144us) server_negotiation.cc:407] Connection header received
0812 11:06:01.645059 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:01.645063 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:01.645108 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:01.645179 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:01.645905 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.646415 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.647249 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.647468 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.647560 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.649977 (+ 2417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:01.650000 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:01.650018 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:01.650048 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:01.651496 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:01.651912 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:01.651918 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:01.651920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:01.652012 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:01.652291 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:01.652294 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:01.652296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:01.652562 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:01.652792 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:01.652950 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 11:06:01.653102 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Aug 12 11:06:01 dist-test-slave-lgr5 krb5kdc[20069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532761, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:06:01 dist-test-slave-lgr5 krb5kdc[20069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532761, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.174.193@KRBTEST.COM
I20260812 11:06:01.681368 20947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.673045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45858 (local address 127.18.174.193:38153)
0812 11:06:01.673176 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:01.673181 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:01.673383 (+ 202us) server_negotiation.cc:407] Connection header received
0812 11:06:01.673533 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:01.673536 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:01.673585 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:01.673656 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:01.674365 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.674903 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.675748 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.675999 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.676147 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.678477 (+ 2330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:01.678481 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:01.678484 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:01.678514 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:01.679657 (+ 1143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:01.680074 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:01.680104 (+ 30us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:01.680106 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:01.680197 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:01.680458 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:01.680462 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:01.680464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:01.680649 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:01.680768 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:01.681077 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 11:06:01.681203 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
Aug 12 11:06:01 dist-test-slave-lgr5 krb5kdc[20069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:06:01 dist-test-slave-lgr5 krb5kdc[20069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.193@KRBTEST.COM
I20260812 11:06:01.708351 20947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:01.700178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45862 (local address 127.18.174.193:38153)
0812 11:06:01.700309 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:01.700314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:01.700470 (+ 156us) server_negotiation.cc:407] Connection header received
0812 11:06:01.700625 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:01.700629 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:01.700680 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:01.700751 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:01.701459 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.701991 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.702835 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:01.703063 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:01.703156 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:01.705501 (+ 2345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:01.705505 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:01.705507 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:01.705535 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:01.706684 (+ 1149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:01.707095 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:01.707098 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:01.707099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:01.707182 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:01.707439 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:01.707443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:01.707444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:01.707631 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:01.707756 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:01.708017 (+ 261us) server_negotiation.cc:299] Negotiation successful
0812 11:06:01.708191 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260812 11:06:01.710192 20322 tablet_service.cc:2908] Rejecting scan request for tablet ca27a60280084ee4a84f9c17677cbd7c: Uninitialized: clean time has not yet been initialized
I20260812 11:06:01.712631 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 20254
I20260812 11:06:01.753145 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 20479
I20260812 11:06:01.766263 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 20699
I20260812 11:06:01.790777 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 20089
2026-08-12T11:06:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2720 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:06:01 dist-test-slave-lgr5 krb5kdc[21000](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:06:01 dist-test-slave-lgr5 krb5kdc[21000](info): set up 2 sockets
Aug 12 11:06:01 dist-test-slave-lgr5 krb5kdc[21000](info): commencing operation
krb5kdc: starting...
W20260812 11:06:02.988579 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:06:03 dist-test-slave-lgr5 krb5kdc[21000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:06:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:06:03.116008 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:46337
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:39769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:46337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:03.231967 21021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:03.232317 21021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:03.232383 21021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:03.236541 21021 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:03.236613 21021 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 11:06:03.236635 21021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:03.236658 21021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:03.236681 21021 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:03.236709 21021 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:03.242245 21021 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:46337
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:46337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:03.243412 21021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:03.244509 21021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:03.253365 21029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:03.253346 21028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:03.253482 21021 server_base.cc:1034] running on GCE node
W20260812 11:06:03.253334 21035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:03.254216 21021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:03.255434 21021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:03.256603 21021 hybrid_clock.cc:648] HybridClock initialized: now 1786532763256585 us; error 33 us; skew 500 ppm
Aug 12 11:06:03 dist-test-slave-lgr5 krb5kdc[21000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532763, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:03.259406 21021 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:06:03.260402 21021 webserver.cc:460] Webserver started at http://127.18.174.254:36513/ using document root <none> and password file <none>
I20260812 11:06:03.260990 21021 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:03.261061 21021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:03.261276 21021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:03.263477 21021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "bcb23e6b61d548ebbb31c446c65b84f1"
format_stamp: "Formatted at 2026-08-12 11:06:03 on dist-test-slave-lgr5"
server_key: "37245a1e94e37c60ddb526b484a2619b"
server_key_iv: "f160c92ea55170293676c9c02cdea03d"
server_key_version: "encryptionkey@0"
I20260812 11:06:03.264101 21021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "bcb23e6b61d548ebbb31c446c65b84f1"
format_stamp: "Formatted at 2026-08-12 11:06:03 on dist-test-slave-lgr5"
server_key: "37245a1e94e37c60ddb526b484a2619b"
server_key_iv: "f160c92ea55170293676c9c02cdea03d"
server_key_version: "encryptionkey@0"
I20260812 11:06:03.268187 21021 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:06:03.270792 21051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:03.272068 21021 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:06:03.272244 21021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "bcb23e6b61d548ebbb31c446c65b84f1"
format_stamp: "Formatted at 2026-08-12 11:06:03 on dist-test-slave-lgr5"
server_key: "37245a1e94e37c60ddb526b484a2619b"
server_key_iv: "f160c92ea55170293676c9c02cdea03d"
server_key_version: "encryptionkey@0"
I20260812 11:06:03.272357 21021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:03.282907 21021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:03.286257 21021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:03.286445 21021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:03.295045 21021 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:46337
I20260812 11:06:03.295120 21169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:46337 every 8 connection(s)
I20260812 11:06:03.296347 21021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:03.299397 21170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:03.303201 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 21021
I20260812 11:06:03.303334 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:03.303628 19131 external_mini_cluster.cc:1428] Setting key 1d0e7034bec9564af79f0c9eae884bb1
I20260812 11:06:03.306106 21170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1: Bootstrap starting.
I20260812 11:06:03.308533 21170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:03.309304 21170 log.cc:824] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:03.311266 21170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1: No bootstrap required, opened a new log
Aug 12 11:06:03 dist-test-slave-lgr5 krb5kdc[21000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:03.315053 21170 raft_consensus.cc:348] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcb23e6b61d548ebbb31c446c65b84f1" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46337 } }
I20260812 11:06:03.315305 21170 raft_consensus.cc:374] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:03.315357 21170 raft_consensus.cc:729] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcb23e6b61d548ebbb31c446c65b84f1, State: Initialized, Role: FOLLOWER
I20260812 11:06:03.315836 21170 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcb23e6b61d548ebbb31c446c65b84f1" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46337 } }
I20260812 11:06:03.315971 21170 raft_consensus.cc:388] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:03.316072 21170 raft_consensus.cc:482] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:03.316208 21170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:03.317180 21170 raft_consensus.cc:504] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcb23e6b61d548ebbb31c446c65b84f1" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46337 } }
I20260812 11:06:03.317587 21170 leader_election.cc:302] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bcb23e6b61d548ebbb31c446c65b84f1; no voters:
I20260812 11:06:03.317938 21170 leader_election.cc:288] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:03.318037 21177 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:03.318267 21177 raft_consensus.cc:686] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [term 1 LEADER]: Becoming Leader. State: Replica: bcb23e6b61d548ebbb31c446c65b84f1, State: Running, Role: LEADER
I20260812 11:06:03.318305 21174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:03.305270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55926 (local address 127.18.174.254:46337)
0812 11:06:03.305779 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:03.305795 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:03.305832 (+ 37us) server_negotiation.cc:407] Connection header received
0812 11:06:03.306537 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:03.306559 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:03.306917 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:03.307243 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:03.308106 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.309189 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.310076 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.310574 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.310741 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:03.313366 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:03.313372 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:03.313388 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:03.313420 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:03.315073 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:03.315577 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:03.315583 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:03.315588 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:03.315710 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:03.316022 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:03.316025 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:03.316026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:03.316547 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:03.316760 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:03.317062 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 11:06:03.317394 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":162,"threads_started":1}
I20260812 11:06:03.318697 21177 consensus_queue.cc:237] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcb23e6b61d548ebbb31c446c65b84f1" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46337 } }
I20260812 11:06:03.319416 21170 sys_catalog.cc:564] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:03.320537 21180 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcb23e6b61d548ebbb31c446c65b84f1. Latest consensus state: current_term: 1 leader_uuid: "bcb23e6b61d548ebbb31c446c65b84f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcb23e6b61d548ebbb31c446c65b84f1" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46337 } } }
I20260812 11:06:03.320678 21180 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:03.320992 21178 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bcb23e6b61d548ebbb31c446c65b84f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcb23e6b61d548ebbb31c446c65b84f1" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46337 } } }
I20260812 11:06:03.321156 21178 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1 [sys.catalog]: This master's current role is: LEADER
W20260812 11:06:03.324507 21202 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:06:03.324584 21202 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:06:03.324671 21192 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:03.325383 21192 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:03.332196 21192 catalog_manager.cc:1347] Generated new cluster ID: 8d7231d062854841a6943f88f1e7cde6
I20260812 11:06:03.332288 21192 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:03.360937 21192 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:03.361989 21192 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:03.371333 21192 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1: Generated new TSK 0
I20260812 11:06:03.372160 21192 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:06:03.408682 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46337
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:39769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:03.525240 21212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:03.525539 21212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:03.525604 21212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:03.529695 21212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:03.529779 21212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:03.529834 21212 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:06:03.529891 21212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:03.536365 21212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.174.254:46337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:03.537542 21212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:03.538652 21212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:03.548599 21227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:03.548641 21221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:03.548637 21212 server_base.cc:1034] running on GCE node
W20260812 11:06:03.548744 21222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:03.549346 21212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:03.550071 21212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:03.551237 21212 hybrid_clock.cc:648] HybridClock initialized: now 1786532763551217 us; error 35 us; skew 500 ppm
Aug 12 11:06:03 dist-test-slave-lgr5 krb5kdc[21000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532763, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:03.554020 21212 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:06:03.554970 21212 webserver.cc:460] Webserver started at http://127.18.174.193:34639/ using document root <none> and password file <none>
I20260812 11:06:03.555570 21212 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:03.555645 21212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:03.555867 21212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:03.558112 21212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "a3ed849db839401eb64006add71eed6a"
format_stamp: "Formatted at 2026-08-12 11:06:03 on dist-test-slave-lgr5"
server_key: "5ca24069b5017643fd00717de55996a8"
server_key_iv: "64a1e6bb9542239ca539c9da1f337275"
server_key_version: "encryptionkey@0"
I20260812 11:06:03.558697 21212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "a3ed849db839401eb64006add71eed6a"
format_stamp: "Formatted at 2026-08-12 11:06:03 on dist-test-slave-lgr5"
server_key: "5ca24069b5017643fd00717de55996a8"
server_key_iv: "64a1e6bb9542239ca539c9da1f337275"
server_key_version: "encryptionkey@0"
I20260812 11:06:03.562667 21212 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:06:03.565258 21239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:03.566471 21212 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:03.566591 21212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "a3ed849db839401eb64006add71eed6a"
format_stamp: "Formatted at 2026-08-12 11:06:03 on dist-test-slave-lgr5"
server_key: "5ca24069b5017643fd00717de55996a8"
server_key_iv: "64a1e6bb9542239ca539c9da1f337275"
server_key_version: "encryptionkey@0"
I20260812 11:06:03.566694 21212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:03.590157 21212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:03.593209 21212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:03.593403 21212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:03.594972 21212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:03.595043 21212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:03.595100 21212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:03.595127 21212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:06:03 dist-test-slave-lgr5 krb5kdc[21000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532763, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:03.605762 21212 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:41237
I20260812 11:06:03.605847 21453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:41237 every 8 connection(s)
I20260812 11:06:03.606796 21212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:06:03.609054 21174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:03.595903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:59673 (local address 127.18.174.254:46337)
0812 11:06:03.596027 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:03.596031 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:03.597209 (+ 1178us) server_negotiation.cc:407] Connection header received
0812 11:06:03.598313 (+ 1104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:03.598317 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:03.598389 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:03.598492 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:03.599985 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.600859 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.602225 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.602467 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.602572 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:03.605367 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:03.605370 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:03.605372 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:03.605401 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:03.606874 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:03.607405 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:03.607409 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:03.607411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:03.607510 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:03.607888 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:03.607891 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:03.607892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:03.608126 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:03.608209 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:03.608780 (+ 571us) server_negotiation.cc:299] Negotiation successful
0812 11:06:03.608916 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:06:03.609819 21258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:03.596536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46337 (local address 127.18.174.193:59673)
0812 11:06:03.597047 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:03.597093 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:03.598013 (+ 920us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:03.598705 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:03.598715 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:03.599134 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:03.599820 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:03.599837 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.601010 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.601014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:03.602089 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:03.602102 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.602633 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.602637 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:03.602833 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:03.603515 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:03.603536 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:03.605182 (+ 1646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:03.606991 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:03.606997 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:03.607014 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:03.607293 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:03.607609 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:03.607612 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:03.607614 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:03.607787 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:03.608221 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:03.608227 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:03.608497 (+ 270us) client_negotiation.cc:769] Sending connection context
0812 11:06:03.608664 (+ 167us) client_negotiation.cc:240] Negotiation successful
0812 11:06:03.608936 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":139,"threads_started":1}
I20260812 11:06:03.611212 21456 heartbeater.cc:347] Connected to a master server at 127.18.174.254:46337
I20260812 11:06:03.611379 21456 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:03.611923 21456 heartbeater.cc:511] Master 127.18.174.254:46337 requested a full tablet report, sending...
I20260812 11:06:03.613734 21083 ts_manager.cc:194] Registered new tserver with Master: a3ed849db839401eb64006add71eed6a (127.18.174.193:41237)
I20260812 11:06:03.615293 21083 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:59673
I20260812 11:06:03.616640 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 21212
I20260812 11:06:03.616770 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:06:03.617082 19131 external_mini_cluster.cc:1428] Setting key 76886a439f2b5c69d72a5b57cf73bc82
I20260812 11:06:03.620980 21174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:03.613442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:53977 (local address 127.18.174.254:46337)
0812 11:06:03.613566 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:03.613570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:03.613694 (+ 124us) server_negotiation.cc:407] Connection header received
0812 11:06:03.613796 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:03.613799 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:03.613851 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:03.613934 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:03.614364 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.615176 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.615997 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.616254 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.616343 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:03.617519 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:03.617524 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:03.617526 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:03.617549 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:03.619209 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:03.619639 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:03.619643 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:03.619645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:03.619736 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:03.620042 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:03.620045 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:03.620047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:03.620280 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:03.620377 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:03.620701 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 11:06:03.620827 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:06:03.620993 21468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:03.613353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46337 (local address 127.18.174.193:53977)
0812 11:06:03.613617 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:03.613629 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:03.613717 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:03.613964 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:03.613967 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:03.614152 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:03.614256 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:03.614262 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.615281 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.615283 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:03.615882 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:03.615891 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.616370 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.616374 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:03.616467 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:03.617029 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:03.617041 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:03.617372 (+ 331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:03.619341 (+ 1969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:03.619344 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:03.619345 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:03.619549 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:03.619823 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:03.619825 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:03.619827 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:03.619963 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:03.620369 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:03.620371 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:03.620470 (+ 99us) client_negotiation.cc:769] Sending connection context
0812 11:06:03.620615 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 11:06:03.620768 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":89,"threads_started":1}
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:06:03.647210 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46337
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:39769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:03.763280 21474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:03.763581 21474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:03.763644 21474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:03.767724 21474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:03.767796 21474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:03.767851 21474 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:06:03.767903 21474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:06:03.773479 21474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.174.254:46337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:03.774623 21474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:03.775756 21474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:03.786342 21489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:03.786378 21487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:03.786342 21481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:03.786572 21474 server_base.cc:1034] running on GCE node
I20260812 11:06:03.787175 21474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:03.787957 21474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:03.789130 21474 hybrid_clock.cc:648] HybridClock initialized: now 1786532763789099 us; error 51 us; skew 500 ppm
Aug 12 11:06:03 dist-test-slave-lgr5 krb5kdc[21000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532763, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:03.791888 21474 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:06:03.792889 21474 webserver.cc:460] Webserver started at http://127.18.174.194:41795/ using document root <none> and password file <none>
I20260812 11:06:03.793447 21474 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:03.793505 21474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:03.793685 21474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:03.795892 21474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "5c808285e27d477c853d0a01bfac7a82"
format_stamp: "Formatted at 2026-08-12 11:06:03 on dist-test-slave-lgr5"
server_key: "5eead60787c325883e28e2299afe8657"
server_key_iv: "3f4a33f1c98ebc1282441e2b61a6e880"
server_key_version: "encryptionkey@0"
I20260812 11:06:03.796515 21474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "5c808285e27d477c853d0a01bfac7a82"
format_stamp: "Formatted at 2026-08-12 11:06:03 on dist-test-slave-lgr5"
server_key: "5eead60787c325883e28e2299afe8657"
server_key_iv: "3f4a33f1c98ebc1282441e2b61a6e880"
server_key_version: "encryptionkey@0"
I20260812 11:06:03.800468 21474 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:06:03.803097 21501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:03.804538 21474 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:03.804659 21474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "5c808285e27d477c853d0a01bfac7a82"
format_stamp: "Formatted at 2026-08-12 11:06:03 on dist-test-slave-lgr5"
server_key: "5eead60787c325883e28e2299afe8657"
server_key_iv: "3f4a33f1c98ebc1282441e2b61a6e880"
server_key_version: "encryptionkey@0"
I20260812 11:06:03.804787 21474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:03.824291 21474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:03.827203 21474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:03.827378 21474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:03.828979 21474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:03.829033 21474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:03.829075 21474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:03.829092 21474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:06:03 dist-test-slave-lgr5 krb5kdc[21000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532763, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:03.839725 21474 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:40385
I20260812 11:06:03.839751 21698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:40385 every 8 connection(s)
I20260812 11:06:03.840725 21474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:06:03.842978 21174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:03.829736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:35653 (local address 127.18.174.254:46337)
0812 11:06:03.829854 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:03.829858 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:03.830937 (+ 1079us) server_negotiation.cc:407] Connection header received
0812 11:06:03.832030 (+ 1093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:03.832034 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:03.832120 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:03.832183 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:03.833599 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.834414 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.835832 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.836219 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.836342 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:03.839306 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:03.839311 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:03.839314 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:03.839352 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:03.840917 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:03.841561 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:03.841566 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:03.841568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:03.841676 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:03.842016 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:03.842018 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:03.842020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:03.842210 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:03.842281 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:03.842734 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 11:06:03.842844 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:06:03.843816 21513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:03.830309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46337 (local address 127.18.174.194:35653)
0812 11:06:03.830790 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:03.830833 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:03.831741 (+ 908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:03.832534 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:03.832540 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:03.832875 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:03.833448 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:03.833467 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.834558 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.834562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:03.835598 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:03.835611 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.836408 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.836413 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:03.836641 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:03.837281 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:03.837299 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:03.839065 (+ 1766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:03.841053 (+ 1988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:03.841059 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:03.841077 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:03.841420 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:03.841785 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:03.841788 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:03.841790 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:03.841942 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:03.842289 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:03.842293 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:03.842541 (+ 248us) client_negotiation.cc:769] Sending connection context
0812 11:06:03.842698 (+ 157us) client_negotiation.cc:240] Negotiation successful
0812 11:06:03.842994 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":126,"threads_started":1}
I20260812 11:06:03.844218 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 21474
I20260812 11:06:03.844355 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:06:03.844648 19131 external_mini_cluster.cc:1428] Setting key 74c0fc2dade90fa21402c803b0d4ac7d
I20260812 11:06:03.845350 21699 heartbeater.cc:347] Connected to a master server at 127.18.174.254:46337
I20260812 11:06:03.845502 21699 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:03.846130 21699 heartbeater.cc:511] Master 127.18.174.254:46337 requested a full tablet report, sending...
I20260812 11:06:03.847352 21084 ts_manager.cc:194] Registered new tserver with Master: 5c808285e27d477c853d0a01bfac7a82 (127.18.174.194:40385)
I20260812 11:06:03.848119 21084 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:35653
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
I20260812 11:06:03.855005 21174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:03.848122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:54145 (local address 127.18.174.254:46337)
0812 11:06:03.848235 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:03.848239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:03.848260 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:06:03.848305 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:03.848308 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:03.848350 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:03.848427 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:03.848966 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.849680 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.850598 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.850820 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.850908 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:03.851991 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:03.851995 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:03.851997 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:03.852024 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:03.853355 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:03.853767 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:03.853770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:03.853772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:03.853854 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:03.854118 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:03.854121 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:03.854123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:03.854348 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:03.854465 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:03.854726 (+ 261us) server_negotiation.cc:299] Negotiation successful
0812 11:06:03.854837 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:06:03.855026 21711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:03.847551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46337 (local address 127.18.174.194:54145)
0812 11:06:03.847815 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:03.847827 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:03.847924 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:03.848535 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:03.848538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:03.848715 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:03.848839 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:03.848847 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.849812 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.849815 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:03.850489 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:03.850500 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:03.850932 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:03.850935 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:03.851032 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:03.851527 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:03.851539 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:03.851854 (+ 315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:03.853472 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:03.853475 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:03.853477 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:03.853674 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:03.853938 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:03.853941 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:03.853943 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:03.854036 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:03.854464 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:03.854467 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:03.854565 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 11:06:03.854656 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 11:06:03.854811 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":88,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:06:03.875315 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46337
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:39769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:03.994146 21722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:03.994443 21722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:03.994494 21722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:03.998656 21722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:03.998723 21722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:03.998767 21722 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:06:03.998821 21722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:06:04.004611 21722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.174.254:46337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:04.005806 21722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:04.006893 21722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:04.017172 21730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:04.017174 21729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:04.017172 21734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:04.017387 21722 server_base.cc:1034] running on GCE node
I20260812 11:06:04.017897 21722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:04.018716 21722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:04.019906 21722 hybrid_clock.cc:648] HybridClock initialized: now 1786532764019885 us; error 59 us; skew 500 ppm
Aug 12 11:06:04 dist-test-slave-lgr5 krb5kdc[21000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532764, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:04.022996 21722 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:06:04.023933 21722 webserver.cc:460] Webserver started at http://127.18.174.195:43613/ using document root <none> and password file <none>
I20260812 11:06:04.024556 21722 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:04.024626 21722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:04.024838 21722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:04.027050 21722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "66b42da2a41b44c98c6d88577945f1af"
format_stamp: "Formatted at 2026-08-12 11:06:04 on dist-test-slave-lgr5"
server_key: "f70684cb362954f54ed812f2d38adc8a"
server_key_iv: "35fbb53fa3be71421b079268e98dbbe2"
server_key_version: "encryptionkey@0"
I20260812 11:06:04.027647 21722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "66b42da2a41b44c98c6d88577945f1af"
format_stamp: "Formatted at 2026-08-12 11:06:04 on dist-test-slave-lgr5"
server_key: "f70684cb362954f54ed812f2d38adc8a"
server_key_iv: "35fbb53fa3be71421b079268e98dbbe2"
server_key_version: "encryptionkey@0"
I20260812 11:06:04.031677 21722 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260812 11:06:04.034621 21746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:04.035956 21722 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:04.036124 21722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "66b42da2a41b44c98c6d88577945f1af"
format_stamp: "Formatted at 2026-08-12 11:06:04 on dist-test-slave-lgr5"
server_key: "f70684cb362954f54ed812f2d38adc8a"
server_key_iv: "35fbb53fa3be71421b079268e98dbbe2"
server_key_version: "encryptionkey@0"
I20260812 11:06:04.036259 21722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:04.058092 21722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:04.061882 21722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:04.062089 21722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:04.063647 21722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:04.063701 21722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:04.063758 21722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:04.063788 21722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:06:04 dist-test-slave-lgr5 krb5kdc[21000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532764, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:04.074198 21722 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:45049
I20260812 11:06:04.074255 21952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:45049 every 8 connection(s)
I20260812 11:06:04.075165 21722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:06:04.077783 21174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.064511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:34443 (local address 127.18.174.254:46337)
0812 11:06:04.064660 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.064665 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.065543 (+ 878us) server_negotiation.cc:407] Connection header received
0812 11:06:04.066628 (+ 1085us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.066632 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.066691 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.066749 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:04.068515 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.069347 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.070819 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.071153 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.071273 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.074075 (+ 2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:04.074078 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:04.074080 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:04.074106 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:04.075598 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:04.076183 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:04.076186 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:04.076188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:04.076277 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:04.076643 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:04.076647 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:04.076649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:04.076854 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:04.076942 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.077487 (+ 545us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.077617 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:06:04.078589 21761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.064921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46337 (local address 127.18.174.195:34443)
0812 11:06:04.065375 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:04.065426 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:04.066367 (+ 941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:04.067194 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:04.067203 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:04.067606 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:04.068335 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.068356 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.069499 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.069503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.070698 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.070711 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.071301 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.071304 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.071545 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.072150 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:04.072171 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:04.073864 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:04.075739 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:04.075746 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:04.075763 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:04.076067 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:04.076364 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:04.076367 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:04.076369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:04.076543 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:04.076954 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:04.076961 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:04.077220 (+ 259us) client_negotiation.cc:769] Sending connection context
0812 11:06:04.077411 (+ 191us) client_negotiation.cc:240] Negotiation successful
0812 11:06:04.077745 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":113,"threads_started":1}
I20260812 11:06:04.079741 21953 heartbeater.cc:347] Connected to a master server at 127.18.174.254:46337
I20260812 11:06:04.079887 21953 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:04.080447 21953 heartbeater.cc:511] Master 127.18.174.254:46337 requested a full tablet report, sending...
I20260812 11:06:04.081565 21083 ts_manager.cc:194] Registered new tserver with Master: 66b42da2a41b44c98c6d88577945f1af (127.18.174.195:45049)
I20260812 11:06:04.082233 21083 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:34443
I20260812 11:06:04.083237 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 21722
I20260812 11:06:04.083349 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:06:04.083606 19131 external_mini_cluster.cc:1428] Setting key dd2caee11c037edf64f238d8f9a0f6a0
I20260812 11:06:04.085683 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:06:04.089329 21964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.081926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46337 (local address 127.18.174.195:48773)
0812 11:06:04.082271 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:04.082284 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:04.082378 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:04.082647 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:04.082650 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:04.082866 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:04.082977 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.082986 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.083962 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.083966 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.084742 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.084755 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.085212 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.085216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.085310 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.085855 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:04.085870 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:04.086285 (+ 415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:04.087930 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:04.087932 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:04.087934 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:04.088169 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:04.088470 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:04.088472 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:04.088474 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:04.088563 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:04.088924 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:04.088926 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:04.089003 (+ 77us) client_negotiation.cc:769] Sending connection context
0812 11:06:04.089073 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 11:06:04.089184 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":95,"threads_started":1}
I20260812 11:06:04.089407 21174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.082014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:48773 (local address 127.18.174.254:46337)
0812 11:06:04.082138 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.082143 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.082385 (+ 242us) server_negotiation.cc:407] Connection header received
0812 11:06:04.082477 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.082488 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.082537 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.082612 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:04.083109 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.083835 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.084850 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.085105 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.085186 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.086431 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:04.086434 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:04.086436 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:04.086460 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:04.087809 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:04.088265 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:04.088268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:04.088270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:04.088391 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:04.088632 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:04.088634 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:04.088636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:04.088842 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:04.088940 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.089145 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.089259 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Aug 12 11:06:04 dist-test-slave-lgr5 krb5kdc[21000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532764, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:06:04 dist-test-slave-lgr5 krb5kdc[21000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532764, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:04.113207 21174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.104928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55932 (local address 127.18.174.254:46337)
0812 11:06:04.105072 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.105077 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.105091 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:06:04.105137 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.105139 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.105179 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.105258 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:04.105972 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.106515 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.107282 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.107504 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.107583 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.110118 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:04.110121 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:04.110124 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:04.110155 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:04.111505 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:04.111964 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:04.111967 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:04.111968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:04.112040 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:04.112360 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:04.112363 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:04.112364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:04.112576 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:04.112683 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.112952 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.113054 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:06:04.116461 21083 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55932:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:06:04.119607 21083 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:04.134562 22001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.129496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59586 (local address 127.18.174.194:40385)
0812 11:06:04.129911 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.129922 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.130295 (+ 373us) server_negotiation.cc:407] Connection header received
0812 11:06:04.130379 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.130384 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.130572 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.130723 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:04.131113 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.131934 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.133253 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.133841 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.133987 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.134142 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.134291 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.134395 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":118,"threads_started":1}
I20260812 11:06:04.134552 21996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.129314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:40385 (local address 127.0.0.1:59586)
0812 11:06:04.130098 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:04.130110 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:04.130198 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:04.130879 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:04.130881 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:04.130898 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:04.130989 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.130995 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.132048 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.132051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.133115 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.133125 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.133976 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.133979 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.134098 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.134138 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 11:06:04.134251 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 11:06:04.134396 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"mutex_wait_us":30,"thread_start_us":96,"threads_started":1}
I20260812 11:06:04.134778 21993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.128664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45049 (local address 127.0.0.1:34708)
0812 11:06:04.129629 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:04.129643 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:04.130254 (+ 611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:04.130720 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:04.130723 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:04.130744 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:04.130843 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.130848 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.132128 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.132132 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.133240 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.133250 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.134410 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.134414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.134508 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.134529 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 11:06:04.134593 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 11:06:04.134653 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":905,"mutex_wait_us":1,"thread_start_us":86,"threads_started":1}
I20260812 11:06:04.134851 21995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.128741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37164 (local address 127.18.174.193:41237)
0812 11:06:04.129040 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.129047 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.129612 (+ 565us) server_negotiation.cc:407] Connection header received
0812 11:06:04.129702 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.129708 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.129931 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.130084 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:04.130381 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.131306 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.133028 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.133872 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.133996 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.134143 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.134630 (+ 487us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.134729 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":100,"threads_started":1}
I20260812 11:06:04.134912 21994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.128590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:41237 (local address 127.0.0.1:37164)
0812 11:06:04.129243 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:04.129298 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:04.129456 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:04.130089 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:04.130095 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:04.130118 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:04.130248 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.130257 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.131425 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.131428 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.132879 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.132891 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.134210 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.134214 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.134302 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.134327 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:06:04.134396 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 11:06:04.134471 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":65,"threads_started":1}
I20260812 11:06:04.135296 21997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.129380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34708 (local address 127.18.174.195:45049)
0812 11:06:04.129920 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.129932 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.129957 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:06:04.130398 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.130403 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.130571 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.130723 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:04.130961 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.131953 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.133368 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.134104 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.134238 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.134352 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.135057 (+ 705us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.135159 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":83,"threads_started":1}
I20260812 11:06:04.137928 21334 tablet_service.cc:1467] Processing CreateTablet for tablet 766bd9362e3844fba336495f93ad1f16 (DEFAULT_TABLE table=test-table [id=7e704abedcc44248bdef5ed23d816bfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:04.138018 21582 tablet_service.cc:1467] Processing CreateTablet for tablet 766bd9362e3844fba336495f93ad1f16 (DEFAULT_TABLE table=test-table [id=7e704abedcc44248bdef5ed23d816bfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:04.138015 21832 tablet_service.cc:1467] Processing CreateTablet for tablet 766bd9362e3844fba336495f93ad1f16 (DEFAULT_TABLE table=test-table [id=7e704abedcc44248bdef5ed23d816bfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:04.139043 21334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 766bd9362e3844fba336495f93ad1f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:04.139117 21832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 766bd9362e3844fba336495f93ad1f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:04.139106 21582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 766bd9362e3844fba336495f93ad1f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:04.146705 22002 tablet_bootstrap.cc:492] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a: Bootstrap starting.
I20260812 11:06:04.147927 22005 tablet_bootstrap.cc:492] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af: Bootstrap starting.
I20260812 11:06:04.148144 22006 tablet_bootstrap.cc:492] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82: Bootstrap starting.
I20260812 11:06:04.149101 22002 tablet_bootstrap.cc:654] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:04.149855 22002 log.cc:824] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:04.150352 22006 tablet_bootstrap.cc:654] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:04.150350 22005 tablet_bootstrap.cc:654] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:04.151227 22006 log.cc:824] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:04.151227 22005 log.cc:824] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:04.152010 22002 tablet_bootstrap.cc:492] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a: No bootstrap required, opened a new log
I20260812 11:06:04.152263 22002 ts_tablet_manager.cc:1397] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:06:04.153128 22006 tablet_bootstrap.cc:492] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82: No bootstrap required, opened a new log
I20260812 11:06:04.153306 22005 tablet_bootstrap.cc:492] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af: No bootstrap required, opened a new log
I20260812 11:06:04.153321 22006 ts_tablet_manager.cc:1397] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:06:04.153545 22005 ts_tablet_manager.cc:1397] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:06:04.156260 22006 raft_consensus.cc:348] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } }
I20260812 11:06:04.156517 22006 raft_consensus.cc:374] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:04.156592 22006 raft_consensus.cc:729] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c808285e27d477c853d0a01bfac7a82, State: Initialized, Role: FOLLOWER
I20260812 11:06:04.157058 22006 consensus_queue.cc:260] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } }
I20260812 11:06:04.157135 22002 raft_consensus.cc:348] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } }
I20260812 11:06:04.157490 22002 raft_consensus.cc:374] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:04.157367 22005 raft_consensus.cc:348] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } }
I20260812 11:06:04.157577 22002 raft_consensus.cc:729] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ed849db839401eb64006add71eed6a, State: Initialized, Role: FOLLOWER
I20260812 11:06:04.157673 22005 raft_consensus.cc:374] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:04.157765 22005 raft_consensus.cc:729] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66b42da2a41b44c98c6d88577945f1af, State: Initialized, Role: FOLLOWER
I20260812 11:06:04.157773 21699 heartbeater.cc:503] Master 127.18.174.254:46337 was elected leader, sending a full tablet report...
I20260812 11:06:04.158166 22006 ts_tablet_manager.cc:1428] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 11:06:04.158185 22002 consensus_queue.cc:260] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } }
I20260812 11:06:04.158872 22005 consensus_queue.cc:260] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } }
I20260812 11:06:04.159632 21953 heartbeater.cc:503] Master 127.18.174.254:46337 was elected leader, sending a full tablet report...
I20260812 11:06:04.159888 22005 ts_tablet_manager.cc:1428] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:06:04.159466 22002 ts_tablet_manager.cc:1428] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 11:06:04.160465 21456 heartbeater.cc:503] Master 127.18.174.254:46337 was elected leader, sending a full tablet report...
I20260812 11:06:04.186216 22013 raft_consensus.cc:482] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:04.186429 22013 raft_consensus.cc:504] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } }
I20260812 11:06:04.187590 22013 leader_election.cc:288] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66b42da2a41b44c98c6d88577945f1af (127.18.174.195:45049), 5c808285e27d477c853d0a01bfac7a82 (127.18.174.194:40385)
I20260812 11:06:04.191756 21997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.187947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:47221 (local address 127.18.174.195:45049)
0812 11:06:04.188099 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.188104 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.188348 (+ 244us) server_negotiation.cc:407] Connection header received
0812 11:06:04.188512 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.188515 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.188560 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.188625 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:04.188908 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.189427 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.190728 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.191232 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.191347 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.191405 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.191562 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.191632 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:06:04.191802 22017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.187842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45049 (local address 127.18.174.193:47221)
0812 11:06:04.188233 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:04.188249 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:04.188380 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:04.188653 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:04.188656 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:04.188672 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:04.188806 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.188811 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.189540 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.189543 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.190610 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.190620 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.191350 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.191353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.191450 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.191470 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:06:04.191537 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:06:04.191610 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":73,"spinlock_wait_cycles":22400,"thread_start_us":126,"threads_started":1}
I20260812 11:06:04.191807 22001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.188009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:41401 (local address 127.18.174.194:40385)
0812 11:06:04.188222 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.188226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.188427 (+ 201us) server_negotiation.cc:407] Connection header received
0812 11:06:04.188556 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.188559 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.188599 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.188663 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:04.188941 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.189426 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.190805 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.191276 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.191388 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.191443 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.191617 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.191690 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260812 11:06:04.191833 22019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.187883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:40385 (local address 127.18.174.193:41401)
0812 11:06:04.188332 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:04.188345 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:04.188456 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:04.188686 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:04.188689 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:04.188730 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:04.188839 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.188844 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.189542 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.189545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.190615 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.190626 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.191388 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.191392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.191504 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.191522 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 11:06:04.191585 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 11:06:04.191653 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"mutex_wait_us":49,"spinlock_wait_cycles":2176,"thread_start_us":129,"threads_started":1}
I20260812 11:06:04.192518 21619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "766bd9362e3844fba336495f93ad1f16" candidate_uuid: "a3ed849db839401eb64006add71eed6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c808285e27d477c853d0a01bfac7a82" is_pre_election: true
I20260812 11:06:04.192565 21873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "766bd9362e3844fba336495f93ad1f16" candidate_uuid: "a3ed849db839401eb64006add71eed6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66b42da2a41b44c98c6d88577945f1af" is_pre_election: true
I20260812 11:06:04.192826 21873 raft_consensus.cc:2454] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ed849db839401eb64006add71eed6a in term 0.
I20260812 11:06:04.192826 21619 raft_consensus.cc:2454] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ed849db839401eb64006add71eed6a in term 0.
I20260812 11:06:04.193267 21246 leader_election.cc:302] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c808285e27d477c853d0a01bfac7a82, a3ed849db839401eb64006add71eed6a; no voters:
I20260812 11:06:04.193562 22013 raft_consensus.cc:2781] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:04.193641 22013 raft_consensus.cc:482] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:04.193673 22013 raft_consensus.cc:3037] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:04.194717 22013 raft_consensus.cc:504] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } }
I20260812 11:06:04.195101 22013 leader_election.cc:288] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [CANDIDATE]: Term 1 election: Requested vote from peers 66b42da2a41b44c98c6d88577945f1af (127.18.174.195:45049), 5c808285e27d477c853d0a01bfac7a82 (127.18.174.194:40385)
I20260812 11:06:04.195456 21873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "766bd9362e3844fba336495f93ad1f16" candidate_uuid: "a3ed849db839401eb64006add71eed6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66b42da2a41b44c98c6d88577945f1af"
I20260812 11:06:04.195451 21619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "766bd9362e3844fba336495f93ad1f16" candidate_uuid: "a3ed849db839401eb64006add71eed6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c808285e27d477c853d0a01bfac7a82"
I20260812 11:06:04.195587 21873 raft_consensus.cc:3037] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:04.195586 21619 raft_consensus.cc:3037] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:04.196743 21873 raft_consensus.cc:2454] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ed849db839401eb64006add71eed6a in term 1.
I20260812 11:06:04.196744 21619 raft_consensus.cc:2454] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ed849db839401eb64006add71eed6a in term 1.
I20260812 11:06:04.197070 21246 leader_election.cc:302] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c808285e27d477c853d0a01bfac7a82, a3ed849db839401eb64006add71eed6a; no voters:
I20260812 11:06:04.197237 22013 raft_consensus.cc:2781] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:04.197466 22013 raft_consensus.cc:686] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [term 1 LEADER]: Becoming Leader. State: Replica: a3ed849db839401eb64006add71eed6a, State: Running, Role: LEADER
I20260812 11:06:04.197849 22013 consensus_queue.cc:237] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } }
I20260812 11:06:04.201086 21083 catalog_manager.cc:5495] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ed849db839401eb64006add71eed6a (127.18.174.193). New cstate: current_term: 1 leader_uuid: "a3ed849db839401eb64006add71eed6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } health_report { overall_health: UNKNOWN } } }
I20260812 11:06:04.223203 21995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.219474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37170 (local address 127.18.174.193:41237)
0812 11:06:04.219620 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.219624 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.219641 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:06:04.219866 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.219868 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.219925 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.220018 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:04.220317 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.220853 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.221811 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.222029 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.222104 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.222362 (+ 258us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:04.222837 (+ 475us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:04.222925 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.222998 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.223056 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:06:04.230525 21873 raft_consensus.cc:1261] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af [term 1 FOLLOWER]: Refusing update from remote peer a3ed849db839401eb64006add71eed6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:04.231462 22013 consensus_queue.cc:1035] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:04.232049 21619 raft_consensus.cc:1261] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82 [term 1 FOLLOWER]: Refusing update from remote peer a3ed849db839401eb64006add71eed6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:04.232757 22013 consensus_queue.cc:1035] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:04.239928 22024 mvcc.cc:205] Tried to move back new op lower bound from 7317638202277195776 to 7317638202157150208. Current Snapshot: MvccSnapshot[applied={T|T < 7317638202277195776}]
I20260812 11:06:04.255275 21083 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:04.255618 21083 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:04.258970 21083 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1: Sending DeleteTablet for 3 replicas of tablet 766bd9362e3844fba336495f93ad1f16
I20260812 11:06:04.259992 21582 tablet_service.cc:1514] Processing DeleteTablet for tablet 766bd9362e3844fba336495f93ad1f16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:04 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:59586
I20260812 11:06:04.259961 21334 tablet_service.cc:1514] Processing DeleteTablet for tablet 766bd9362e3844fba336495f93ad1f16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:04 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:37164
I20260812 11:06:04.259968 21832 tablet_service.cc:1514] Processing DeleteTablet for tablet 766bd9362e3844fba336495f93ad1f16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:04 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:34708
I20260812 11:06:04.260637 22040 tablet_replica.cc:330] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a: stopping tablet replica
I20260812 11:06:04.260666 22036 tablet_replica.cc:330] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af: stopping tablet replica
I20260812 11:06:04.260929 22040 raft_consensus.cc:2229] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:06:04.260975 22036 raft_consensus.cc:2229] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:04.261276 22040 raft_consensus.cc:2258] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:04.261313 22036 raft_consensus.cc:2258] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:04.262588 21083 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55932:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:06:04.262987 21083 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:04.263209 22040 ts_tablet_manager.cc:1905] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:04.263896 22041 tablet_replica.cc:330] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82: stopping tablet replica
I20260812 11:06:04.264321 22041 raft_consensus.cc:2229] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:04.264724 22041 raft_consensus.cc:2258] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:04.265827 22036 ts_tablet_manager.cc:1905] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:04.266345 22041 ts_tablet_manager.cc:1905] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:04.268792 22036 ts_tablet_manager.cc:1918] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:04.268953 22036 log.cc:1196] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/766bd9362e3844fba336495f93ad1f16
I20260812 11:06:04.269376 22036 ts_tablet_manager.cc:1939] T 766bd9362e3844fba336495f93ad1f16 P 66b42da2a41b44c98c6d88577945f1af: Deleting consensus metadata
I20260812 11:06:04.269971 21334 tablet_service.cc:1467] Processing CreateTablet for tablet aace1067cf80458aaebe9ca900a63366 (DEFAULT_TABLE table=test-table [id=5cb5f1db14d2405ebffb5a04a060f67b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:04.269860 21832 tablet_service.cc:1467] Processing CreateTablet for tablet aace1067cf80458aaebe9ca900a63366 (DEFAULT_TABLE table=test-table [id=5cb5f1db14d2405ebffb5a04a060f67b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:04.270126 21582 tablet_service.cc:1467] Processing CreateTablet for tablet aace1067cf80458aaebe9ca900a63366 (DEFAULT_TABLE table=test-table [id=5cb5f1db14d2405ebffb5a04a060f67b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:04.270274 21832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aace1067cf80458aaebe9ca900a63366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:04.270366 21582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aace1067cf80458aaebe9ca900a63366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:04.271495 21334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aace1067cf80458aaebe9ca900a63366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:04.272667 22005 tablet_bootstrap.cc:492] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af: Bootstrap starting.
I20260812 11:06:04.273699 22005 tablet_bootstrap.cc:654] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:04.274339 22002 tablet_bootstrap.cc:492] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a: Bootstrap starting.
I20260812 11:06:04.274360 22006 tablet_bootstrap.cc:492] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82: Bootstrap starting.
I20260812 11:06:04.275178 22006 tablet_bootstrap.cc:654] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:04.275327 22002 tablet_bootstrap.cc:654] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:04.276376 22006 tablet_bootstrap.cc:492] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82: No bootstrap required, opened a new log
I20260812 11:06:04.276474 22006 ts_tablet_manager.cc:1397] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260812 11:06:04.276824 22041 ts_tablet_manager.cc:1918] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:04.276916 22041 log.cc:1196] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/766bd9362e3844fba336495f93ad1f16
I20260812 11:06:04.277000 22006 raft_consensus.cc:348] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.277107 22006 raft_consensus.cc:374] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:04.277135 22006 raft_consensus.cc:729] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c808285e27d477c853d0a01bfac7a82, State: Initialized, Role: FOLLOWER
I20260812 11:06:04.277235 22041 ts_tablet_manager.cc:1939] T 766bd9362e3844fba336495f93ad1f16 P 5c808285e27d477c853d0a01bfac7a82: Deleting consensus metadata
I20260812 11:06:04.277269 22006 consensus_queue.cc:260] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.277547 22006 ts_tablet_manager.cc:1428] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 11:06:04.277652 22040 ts_tablet_manager.cc:1918] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:04.277755 22040 log.cc:1196] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/wal/wals/766bd9362e3844fba336495f93ad1f16
I20260812 11:06:04.278048 22040 ts_tablet_manager.cc:1939] T 766bd9362e3844fba336495f93ad1f16 P a3ed849db839401eb64006add71eed6a: Deleting consensus metadata
I20260812 11:06:04.279331 21058 catalog_manager.cc:4841] TS a3ed849db839401eb64006add71eed6a (127.18.174.193:41237): tablet 766bd9362e3844fba336495f93ad1f16 (table test-table [id=7e704abedcc44248bdef5ed23d816bfb]) successfully deleted
I20260812 11:06:04.279354 21063 catalog_manager.cc:4841] TS 66b42da2a41b44c98c6d88577945f1af (127.18.174.195:45049): tablet 766bd9362e3844fba336495f93ad1f16 (table test-table [id=7e704abedcc44248bdef5ed23d816bfb]) successfully deleted
I20260812 11:06:04.280838 21058 catalog_manager.cc:4841] TS 5c808285e27d477c853d0a01bfac7a82 (127.18.174.194:40385): tablet 766bd9362e3844fba336495f93ad1f16 (table test-table [id=7e704abedcc44248bdef5ed23d816bfb]) successfully deleted
I20260812 11:06:04.280910 22002 tablet_bootstrap.cc:492] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a: No bootstrap required, opened a new log
I20260812 11:06:04.280994 22002 ts_tablet_manager.cc:1397] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260812 11:06:04.281505 22002 raft_consensus.cc:348] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.281620 22002 raft_consensus.cc:374] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:04.281657 22002 raft_consensus.cc:729] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ed849db839401eb64006add71eed6a, State: Initialized, Role: FOLLOWER
I20260812 11:06:04.281772 22002 consensus_queue.cc:260] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.281952 22005 tablet_bootstrap.cc:492] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af: No bootstrap required, opened a new log
I20260812 11:06:04.282027 22002 ts_tablet_manager.cc:1428] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:04.282065 22005 ts_tablet_manager.cc:1397] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260812 11:06:04.282552 22005 raft_consensus.cc:348] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.282671 22005 raft_consensus.cc:374] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:04.282704 22005 raft_consensus.cc:729] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66b42da2a41b44c98c6d88577945f1af, State: Initialized, Role: FOLLOWER
I20260812 11:06:04.282828 22005 consensus_queue.cc:260] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.283102 22005 ts_tablet_manager.cc:1428] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260812 11:06:04.326201 21955 tablet.cc:2369] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:06:04.342067 21700 tablet.cc:2369] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:06:04.358404 21457 tablet.cc:2369] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:06:04.449749 22016 raft_consensus.cc:482] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:04.449921 22016 raft_consensus.cc:504] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.451027 22016 leader_election.cc:288] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ed849db839401eb64006add71eed6a (127.18.174.193:41237), 5c808285e27d477c853d0a01bfac7a82 (127.18.174.194:40385)
I20260812 11:06:04.454784 21761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.451336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:41237 (local address 127.18.174.195:40853)
0812 11:06:04.451489 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:04.451508 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:04.451647 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:04.451954 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:04.451957 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:04.451976 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:04.452123 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.452132 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.452860 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.452863 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.453695 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.453706 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.454341 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.454345 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.454457 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.454488 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 11:06:04.454556 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 11:06:04.454636 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":23}
I20260812 11:06:04.454784 21995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.451432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:40853 (local address 127.18.174.193:41237)
0812 11:06:04.451589 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.451594 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.451611 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:06:04.451775 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.451779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.451839 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.451922 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:04.452247 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.452747 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.453820 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.454226 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.454341 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.454406 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.454585 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.454663 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 11:06:04.455075 22001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.451771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:44787 (local address 127.18.174.194:40385)
0812 11:06:04.451901 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.451906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.452108 (+ 202us) server_negotiation.cc:407] Connection header received
0812 11:06:04.452216 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.452219 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.452261 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.452323 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:04.452591 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.453083 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.454130 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.454528 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.454637 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.454689 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.454879 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.454951 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:06:04.455101 22046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.451637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:40385 (local address 127.18.174.195:44787)
0812 11:06:04.451991 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:04.452002 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:04.452126 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:04.452345 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:04.452348 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:04.452363 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:04.452483 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.452488 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.453194 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.453197 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.454004 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.454014 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.454659 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.454663 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.454760 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.454781 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 11:06:04.454846 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 11:06:04.454917 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":1,"thread_start_us":112,"threads_started":1}
I20260812 11:06:04.455509 21619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aace1067cf80458aaebe9ca900a63366" candidate_uuid: "66b42da2a41b44c98c6d88577945f1af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c808285e27d477c853d0a01bfac7a82" is_pre_election: true
I20260812 11:06:04.455574 21368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aace1067cf80458aaebe9ca900a63366" candidate_uuid: "66b42da2a41b44c98c6d88577945f1af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ed849db839401eb64006add71eed6a" is_pre_election: true
I20260812 11:06:04.455664 21619 raft_consensus.cc:2454] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66b42da2a41b44c98c6d88577945f1af in term 0.
I20260812 11:06:04.455837 21368 raft_consensus.cc:2454] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66b42da2a41b44c98c6d88577945f1af in term 0.
I20260812 11:06:04.456110 21751 leader_election.cc:302] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c808285e27d477c853d0a01bfac7a82, 66b42da2a41b44c98c6d88577945f1af; no voters:
I20260812 11:06:04.456388 22016 raft_consensus.cc:2781] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:04.456455 22016 raft_consensus.cc:482] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:04.456501 22016 raft_consensus.cc:3037] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:04.457538 22016 raft_consensus.cc:504] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.457883 22016 leader_election.cc:288] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [CANDIDATE]: Term 1 election: Requested vote from peers a3ed849db839401eb64006add71eed6a (127.18.174.193:41237), 5c808285e27d477c853d0a01bfac7a82 (127.18.174.194:40385)
I20260812 11:06:04.458303 21368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aace1067cf80458aaebe9ca900a63366" candidate_uuid: "66b42da2a41b44c98c6d88577945f1af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ed849db839401eb64006add71eed6a"
I20260812 11:06:04.458351 21619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aace1067cf80458aaebe9ca900a63366" candidate_uuid: "66b42da2a41b44c98c6d88577945f1af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c808285e27d477c853d0a01bfac7a82"
I20260812 11:06:04.458433 21368 raft_consensus.cc:3037] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:04.458461 21619 raft_consensus.cc:3037] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:04.459381 21619 raft_consensus.cc:2454] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66b42da2a41b44c98c6d88577945f1af in term 1.
I20260812 11:06:04.459406 21368 raft_consensus.cc:2454] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66b42da2a41b44c98c6d88577945f1af in term 1.
I20260812 11:06:04.459693 21751 leader_election.cc:302] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66b42da2a41b44c98c6d88577945f1af, a3ed849db839401eb64006add71eed6a; no voters:
I20260812 11:06:04.459884 22016 raft_consensus.cc:2781] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:04.460145 22016 raft_consensus.cc:686] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [term 1 LEADER]: Becoming Leader. State: Replica: 66b42da2a41b44c98c6d88577945f1af, State: Running, Role: LEADER
I20260812 11:06:04.460628 22016 consensus_queue.cc:237] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.463145 21084 catalog_manager.cc:5495] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af reported cstate change: term changed from 0 to 1, leader changed from <none> to 66b42da2a41b44c98c6d88577945f1af (127.18.174.195). New cstate: current_term: 1 leader_uuid: "66b42da2a41b44c98c6d88577945f1af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } health_report { overall_health: HEALTHY } } }
Aug 12 11:06:04 dist-test-slave-lgr5 krb5kdc[21000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532763, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:04.538885 22065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.529964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46337 (local address 127.0.0.1:55944)
0812 11:06:04.530285 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:04.530298 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:04.530430 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:04.530656 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:04.530659 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:04.531098 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:04.531200 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.531207 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.531932 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.531936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.532523 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.532534 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.532937 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.532940 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.533068 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.533688 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:04.533703 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:04.535548 (+ 1845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:04.537431 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:04.537441 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:04.537447 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:04.537695 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:04.537947 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:04.537950 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:04.537951 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:04.538025 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:04.538342 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:04.538348 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:04.538485 (+ 137us) client_negotiation.cc:769] Sending connection context
0812 11:06:04.538575 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 11:06:04.538709 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":33,"thread_start_us":122,"threads_started":1}
I20260812 11:06:04.538900 21174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.530009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55944 (local address 127.18.174.254:46337)
0812 11:06:04.530130 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.530135 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.530382 (+ 247us) server_negotiation.cc:407] Connection header received
0812 11:06:04.530515 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.530518 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.530556 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.530621 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:04.531315 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.531829 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.532634 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.532837 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.532924 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.535732 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:04.535736 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:04.535753 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:04.535782 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:04.537293 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:04.537791 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:04.537794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:04.537795 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:04.537877 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:04.538092 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:04.538094 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:04.538095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:04.538269 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:04.538370 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.538621 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.538768 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":40}
I20260812 11:06:04.543248 21084 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:55944:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 11:06:04.544061 21084 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:04.549052 21334 tablet_service.cc:1467] Processing CreateTablet for tablet 2a332bf3b9f04fe6afe47ecc8135444f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=767d2d20fe864ae1bfd5ebea32aa4e4a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:06:04.549055 21582 tablet_service.cc:1467] Processing CreateTablet for tablet 2a332bf3b9f04fe6afe47ecc8135444f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=767d2d20fe864ae1bfd5ebea32aa4e4a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:06:04.549278 21832 tablet_service.cc:1467] Processing CreateTablet for tablet 2a332bf3b9f04fe6afe47ecc8135444f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=767d2d20fe864ae1bfd5ebea32aa4e4a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:06:04.549532 21334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a332bf3b9f04fe6afe47ecc8135444f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:04.549533 21582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a332bf3b9f04fe6afe47ecc8135444f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:04.549640 21832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a332bf3b9f04fe6afe47ecc8135444f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:04.551910 22002 tablet_bootstrap.cc:492] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a: Bootstrap starting.
I20260812 11:06:04.552461 22005 tablet_bootstrap.cc:492] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af: Bootstrap starting.
I20260812 11:06:04.552842 22002 tablet_bootstrap.cc:654] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:04.553388 22005 tablet_bootstrap.cc:654] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:04.554045 22006 tablet_bootstrap.cc:492] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82: Bootstrap starting.
I20260812 11:06:04.554131 22002 tablet_bootstrap.cc:492] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a: No bootstrap required, opened a new log
I20260812 11:06:04.554214 22002 ts_tablet_manager.cc:1397] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:06:04.554672 22002 raft_consensus.cc:348] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.554790 22002 raft_consensus.cc:374] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:04.554821 22002 raft_consensus.cc:729] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ed849db839401eb64006add71eed6a, State: Initialized, Role: FOLLOWER
I20260812 11:06:04.554967 22006 tablet_bootstrap.cc:654] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:04.554957 22002 consensus_queue.cc:260] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.555253 22002 ts_tablet_manager.cc:1428] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 11:06:04.555656 22020 tablet_replica.cc:439] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } }
I20260812 11:06:04.555788 22020 tablet_replica.cc:442] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:04.556362 22005 tablet_bootstrap.cc:492] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af: No bootstrap required, opened a new log
I20260812 11:06:04.556452 22005 ts_tablet_manager.cc:1397] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 11:06:04.556847 22005 raft_consensus.cc:348] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.556944 22005 raft_consensus.cc:374] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:04.556991 22005 raft_consensus.cc:729] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66b42da2a41b44c98c6d88577945f1af, State: Initialized, Role: FOLLOWER
I20260812 11:06:04.557119 22005 consensus_queue.cc:260] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.557667 22005 ts_tablet_manager.cc:1428] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:04.557906 22016 tablet_replica.cc:439] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } }
I20260812 11:06:04.558060 22016 tablet_replica.cc:442] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:04.559074 22006 tablet_bootstrap.cc:492] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82: No bootstrap required, opened a new log
I20260812 11:06:04.559159 22006 ts_tablet_manager.cc:1397] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260812 11:06:04.559579 22006 raft_consensus.cc:348] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.559681 22006 raft_consensus.cc:374] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:04.559701 22006 raft_consensus.cc:729] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c808285e27d477c853d0a01bfac7a82, State: Initialized, Role: FOLLOWER
I20260812 11:06:04.559823 22006 consensus_queue.cc:260] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.560065 22006 ts_tablet_manager.cc:1428] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 11:06:04.560073 22011 tablet_replica.cc:439] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } }
I20260812 11:06:04.560322 22011 tablet_replica.cc:442] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:04.574106 22016 raft_consensus.cc:482] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:04.574240 22016 raft_consensus.cc:504] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.574663 22016 leader_election.cc:288] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3ed849db839401eb64006add71eed6a (127.18.174.193:41237), 5c808285e27d477c853d0a01bfac7a82 (127.18.174.194:40385)
I20260812 11:06:04.575101 21368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a332bf3b9f04fe6afe47ecc8135444f" candidate_uuid: "66b42da2a41b44c98c6d88577945f1af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ed849db839401eb64006add71eed6a" is_pre_election: true
I20260812 11:06:04.575135 21619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a332bf3b9f04fe6afe47ecc8135444f" candidate_uuid: "66b42da2a41b44c98c6d88577945f1af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c808285e27d477c853d0a01bfac7a82" is_pre_election: true
I20260812 11:06:04.575269 21619 raft_consensus.cc:2454] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66b42da2a41b44c98c6d88577945f1af in term 0.
I20260812 11:06:04.575274 21368 raft_consensus.cc:2454] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66b42da2a41b44c98c6d88577945f1af in term 0.
I20260812 11:06:04.575603 21751 leader_election.cc:302] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66b42da2a41b44c98c6d88577945f1af, a3ed849db839401eb64006add71eed6a; no voters:
I20260812 11:06:04.575776 22016 raft_consensus.cc:2781] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:04.575848 22016 raft_consensus.cc:482] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:04.575896 22016 raft_consensus.cc:3037] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:04.576936 22016 raft_consensus.cc:504] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.577222 22016 leader_election.cc:288] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [CANDIDATE]: Term 1 election: Requested vote from peers a3ed849db839401eb64006add71eed6a (127.18.174.193:41237), 5c808285e27d477c853d0a01bfac7a82 (127.18.174.194:40385)
I20260812 11:06:04.577561 21368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a332bf3b9f04fe6afe47ecc8135444f" candidate_uuid: "66b42da2a41b44c98c6d88577945f1af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3ed849db839401eb64006add71eed6a"
I20260812 11:06:04.577646 21619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a332bf3b9f04fe6afe47ecc8135444f" candidate_uuid: "66b42da2a41b44c98c6d88577945f1af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c808285e27d477c853d0a01bfac7a82"
I20260812 11:06:04.577699 21368 raft_consensus.cc:3037] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:04.577773 21619 raft_consensus.cc:3037] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:04.578867 21368 raft_consensus.cc:2454] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66b42da2a41b44c98c6d88577945f1af in term 1.
I20260812 11:06:04.578867 21619 raft_consensus.cc:2454] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66b42da2a41b44c98c6d88577945f1af in term 1.
I20260812 11:06:04.579217 21751 leader_election.cc:302] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66b42da2a41b44c98c6d88577945f1af, a3ed849db839401eb64006add71eed6a; no voters:
I20260812 11:06:04.579427 22016 raft_consensus.cc:2781] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:04.579535 22016 raft_consensus.cc:686] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [term 1 LEADER]: Becoming Leader. State: Replica: 66b42da2a41b44c98c6d88577945f1af, State: Running, Role: LEADER
I20260812 11:06:04.579697 22016 consensus_queue.cc:237] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } }
I20260812 11:06:04.580482 22047 tablet_replica.cc:439] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af: TxnStatusTablet state changed. Reason: New leader 66b42da2a41b44c98c6d88577945f1af. Latest consensus state: current_term: 1 leader_uuid: "66b42da2a41b44c98c6d88577945f1af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } }
I20260812 11:06:04.580633 22047 tablet_replica.cc:442] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:06:04.581036 22073 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 11:06:04.581252 22073 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 11:06:04.581568 21084 catalog_manager.cc:5495] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af reported cstate change: term changed from 0 to 1, leader changed from <none> to 66b42da2a41b44c98c6d88577945f1af (127.18.174.195). New cstate: current_term: 1 leader_uuid: "66b42da2a41b44c98c6d88577945f1af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } health_report { overall_health: HEALTHY } } }
I20260812 11:06:04.601195 21997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.597695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34716 (local address 127.18.174.195:45049)
0812 11:06:04.597831 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.597836 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.597850 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:06:04.598011 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.598013 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.598071 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.598152 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:04.598389 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.598881 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.599719 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.599930 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.600025 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.600348 (+ 323us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:04.600786 (+ 438us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:04.600891 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.600991 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.601048 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:06:04.601195 22065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.597573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45049 (local address 127.0.0.1:34716)
0812 11:06:04.597730 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:04.597746 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:04.597861 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:04.598179 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:04.598182 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:04.598189 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:06:04.598293 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.598298 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.598994 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.598997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.599607 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.599616 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.600029 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.600033 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.600156 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.600207 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:06:04.600881 (+ 674us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:06:04.600897 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 11:06:04.600963 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 11:06:04.601059 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 11:06:04.604238 21619 raft_consensus.cc:1261] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82 [term 1 FOLLOWER]: Refusing update from remote peer 66b42da2a41b44c98c6d88577945f1af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:04.604501 21368 raft_consensus.cc:1261] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a [term 1 FOLLOWER]: Refusing update from remote peer 66b42da2a41b44c98c6d88577945f1af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:04.604743 22047 consensus_queue.cc:1035] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:04.605079 22016 consensus_queue.cc:1035] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:04.606876 22011 tablet_replica.cc:439] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82: TxnStatusTablet state changed. Reason: New leader 66b42da2a41b44c98c6d88577945f1af. Latest consensus state: current_term: 1 leader_uuid: "66b42da2a41b44c98c6d88577945f1af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } }
I20260812 11:06:04.607003 22011 tablet_replica.cc:442] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:04.607163 22020 tablet_replica.cc:439] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a: TxnStatusTablet state changed. Reason: New leader 66b42da2a41b44c98c6d88577945f1af. Latest consensus state: current_term: 1 leader_uuid: "66b42da2a41b44c98c6d88577945f1af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } }
I20260812 11:06:04.607266 22020 tablet_replica.cc:442] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:04.610574 22047 tablet_replica.cc:439] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "66b42da2a41b44c98c6d88577945f1af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } }
I20260812 11:06:04.610705 22047 tablet_replica.cc:442] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:06:04.610800 22047 tablet_replica.cc:439] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "66b42da2a41b44c98c6d88577945f1af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } }
I20260812 11:06:04.610852 22047 tablet_replica.cc:442] T 2a332bf3b9f04fe6afe47ecc8135444f P 66b42da2a41b44c98c6d88577945f1af: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:06:04.612474 22025 mvcc.cc:205] Tried to move back new op lower bound from 7317638203813687296 to 7317638203719770112. Current Snapshot: MvccSnapshot[applied={T|T < 7317638203813687296 or (T in {7317638203813687296})}]
I20260812 11:06:04.612831 22020 tablet_replica.cc:439] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "66b42da2a41b44c98c6d88577945f1af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } }
I20260812 11:06:04.612957 22020 tablet_replica.cc:442] T 2a332bf3b9f04fe6afe47ecc8135444f P a3ed849db839401eb64006add71eed6a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:04.615665 22011 tablet_replica.cc:439] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "66b42da2a41b44c98c6d88577945f1af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 } } peers { permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 } } peers { permanent_uuid: "66b42da2a41b44c98c6d88577945f1af" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45049 } } }
I20260812 11:06:04.615804 22011 tablet_replica.cc:442] T 2a332bf3b9f04fe6afe47ecc8135444f P 5c808285e27d477c853d0a01bfac7a82: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:04.622167 21997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.618034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34728 (local address 127.18.174.195:45049)
0812 11:06:04.618139 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.618144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.618157 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:06:04.618202 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.618205 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.618255 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.618328 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:04.618684 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.619479 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.620687 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.621076 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.621166 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.621494 (+ 328us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:04.621582 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:04.621635 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.621963 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.622029 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:06:04.635757 21997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.631892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:38921 (local address 127.18.174.195:45049)
0812 11:06:04.632013 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.632018 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.632269 (+ 251us) server_negotiation.cc:407] Connection header received
0812 11:06:04.632398 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.632402 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.632467 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.632528 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:04.632763 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.633271 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.634536 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.634742 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.634817 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.635138 (+ 321us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:04.635210 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:04.635276 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.635516 (+ 240us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.635589 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":44}
I20260812 11:06:04.635768 22087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.631803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45049 (local address 127.18.174.195:38921)
0812 11:06:04.632191 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:04.632202 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:04.632312 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:04.632550 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:04.632552 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:04.632559 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:06:04.632675 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.632680 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.633415 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.633419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.634417 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:04.634431 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.634857 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.634860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:04.634955 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.635023 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:06:04.635410 (+ 387us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:06:04.635416 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:06:04.635498 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 11:06:04.635599 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":3,"thread_start_us":92,"threads_started":1}
I20260812 11:06:04.645184 21368 raft_consensus.cc:1261] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a [term 1 FOLLOWER]: Refusing update from remote peer 66b42da2a41b44c98c6d88577945f1af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:04.645210 21619 raft_consensus.cc:1261] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82 [term 1 FOLLOWER]: Refusing update from remote peer 66b42da2a41b44c98c6d88577945f1af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:04.645651 22047 consensus_queue.cc:1035] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c808285e27d477c853d0a01bfac7a82" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:04.645869 22083 consensus_queue.cc:1035] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3ed849db839401eb64006add71eed6a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:04.654608 22026 mvcc.cc:205] Tried to move back new op lower bound from 7317638203982569472 to 7317638203233382400. Current Snapshot: MvccSnapshot[applied={T|T < 7317638203982569472}]
I20260812 11:06:04.685292 21083 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:04.685461 21083 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:04.687704 21083 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bcb23e6b61d548ebbb31c446c65b84f1: Sending DeleteTablet for 3 replicas of tablet aace1067cf80458aaebe9ca900a63366
I20260812 11:06:04.688388 21334 tablet_service.cc:1514] Processing DeleteTablet for tablet aace1067cf80458aaebe9ca900a63366 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:04 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:37164
I20260812 11:06:04.688552 21582 tablet_service.cc:1514] Processing DeleteTablet for tablet aace1067cf80458aaebe9ca900a63366 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:04 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:59586
I20260812 11:06:04.688611 22040 tablet_replica.cc:330] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a: stopping tablet replica
I20260812 11:06:04.688668 21830 tablet_service.cc:1514] Processing DeleteTablet for tablet aace1067cf80458aaebe9ca900a63366 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:04 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:34708
I20260812 11:06:04.688727 22041 tablet_replica.cc:330] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82: stopping tablet replica
I20260812 11:06:04.688735 22040 raft_consensus.cc:2229] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:04.688822 22041 raft_consensus.cc:2229] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:04.688859 22040 raft_consensus.cc:2258] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:04.688864 22036 tablet_replica.cc:330] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af: stopping tablet replica
I20260812 11:06:04.688921 22041 raft_consensus.cc:2258] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:04.688971 22036 raft_consensus.cc:2229] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:06:04.689283 22036 raft_consensus.cc:2258] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:04.689658 22040 ts_tablet_manager.cc:1905] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:04.689658 22041 ts_tablet_manager.cc:1905] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:04.690347 22036 ts_tablet_manager.cc:1905] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:04.692619 22041 ts_tablet_manager.cc:1918] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:06:04.692709 22041 log.cc:1196] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/aace1067cf80458aaebe9ca900a63366
I20260812 11:06:04.692817 22040 ts_tablet_manager.cc:1918] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:06:04.692879 22040 log.cc:1196] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-0/wal/wals/aace1067cf80458aaebe9ca900a63366
I20260812 11:06:04.692948 22041 ts_tablet_manager.cc:1939] T aace1067cf80458aaebe9ca900a63366 P 5c808285e27d477c853d0a01bfac7a82: Deleting consensus metadata
I20260812 11:06:04.693096 22040 ts_tablet_manager.cc:1939] T aace1067cf80458aaebe9ca900a63366 P a3ed849db839401eb64006add71eed6a: Deleting consensus metadata
I20260812 11:06:04.693774 21058 catalog_manager.cc:4841] TS a3ed849db839401eb64006add71eed6a (127.18.174.193:41237): tablet aace1067cf80458aaebe9ca900a63366 (table test-table [id=5cb5f1db14d2405ebffb5a04a060f67b]) successfully deleted
I20260812 11:06:04.693985 21058 catalog_manager.cc:4841] TS 5c808285e27d477c853d0a01bfac7a82 (127.18.174.194:40385): tablet aace1067cf80458aaebe9ca900a63366 (table test-table [id=5cb5f1db14d2405ebffb5a04a060f67b]) successfully deleted
I20260812 11:06:04.695127 22036 ts_tablet_manager.cc:1918] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:06:04.695214 22036 log.cc:1196] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/aace1067cf80458aaebe9ca900a63366
I20260812 11:06:04.695501 22036 ts_tablet_manager.cc:1939] T aace1067cf80458aaebe9ca900a63366 P 66b42da2a41b44c98c6d88577945f1af: Deleting consensus metadata
I20260812 11:06:04.696266 21063 catalog_manager.cc:4841] TS 66b42da2a41b44c98c6d88577945f1af (127.18.174.195:45049): tablet aace1067cf80458aaebe9ca900a63366 (table test-table [id=5cb5f1db14d2405ebffb5a04a060f67b]) successfully deleted
Aug 12 11:06:04 dist-test-slave-lgr5 krb5kdc[21000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532764, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.174.193@KRBTEST.COM
I20260812 11:06:04.704840 21995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.694264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37186 (local address 127.18.174.193:41237)
0812 11:06:04.694379 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.694384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.694670 (+ 286us) server_negotiation.cc:407] Connection header received
0812 11:06:04.694853 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.694856 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.694904 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.694969 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:04.695761 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.696380 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.697218 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.697447 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.697547 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.701159 (+ 3612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:04.701173 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:04.701188 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:04.701217 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:04.702848 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:04.703408 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:04.703415 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:04.703417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:04.703524 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:04.703801 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:04.703803 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:04.703804 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:04.704115 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:04.704297 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.704559 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.704678 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260812 11:06:04.705469 21446 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37186
I20260812 11:06:04.715446 21174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:04.707338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55960 (local address 127.18.174.254:46337)
0812 11:06:04.707507 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:04.707511 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:04.707796 (+ 285us) server_negotiation.cc:407] Connection header received
0812 11:06:04.707927 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:04.707931 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:04.707991 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:04.708123 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:04.708785 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.709541 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.710337 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:04.710673 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:04.710796 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:04.712210 (+ 1414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:04.712214 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:04.712217 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:04.712247 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:04.713798 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:04.714209 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:04.714213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:04.714215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:04.714311 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:04.714537 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:04.714540 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:04.714542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:04.714784 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:04.714918 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:04.715146 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 11:06:04.715278 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260812 11:06:04.715943 21083 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55960
I20260812 11:06:04.717294 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 21212
I20260812 11:06:04.729437 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 21474
I20260812 11:06:04.743338 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 21722
I20260812 11:06:04.764822 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 21021
2026-08-12T11:06:04Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2988 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:06:04 dist-test-slave-lgr5 krb5kdc[22105](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:06:04 dist-test-slave-lgr5 krb5kdc[22105](info): set up 2 sockets
Aug 12 11:06:04 dist-test-slave-lgr5 krb5kdc[22105](info): commencing operation
krb5kdc: starting...
W20260812 11:06:05.999105 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:06:06 dist-test-slave-lgr5 krb5kdc[22105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532766, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:06:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:06:06.130678 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:46841
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:32849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:46841
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:06.257917 22135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:06.258215 22135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:06.258258 22135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:06.262393 22135 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:06.262466 22135 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 11:06:06.262488 22135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:06.262506 22135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:06.262521 22135 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:06.262537 22135 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:06.268159 22135 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:32849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:46841
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:46841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22135
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:06.269471 22135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:06.270617 22135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:06.279785 22148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:06.280005 22135 server_base.cc:1034] running on GCE node
W20260812 11:06:06.279875 22149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:06.279793 22152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:06.280761 22135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:06.281987 22135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:06.283190 22135 hybrid_clock.cc:648] HybridClock initialized: now 1786532766283170 us; error 33 us; skew 500 ppm
Aug 12 11:06:06 dist-test-slave-lgr5 krb5kdc[22105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532766, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:06.286159 22135 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:06:06.287216 22135 webserver.cc:460] Webserver started at http://127.18.174.254:39811/ using document root <none> and password file <none>
I20260812 11:06:06.287794 22135 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:06.287858 22135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:06.288058 22135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:06.290315 22135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "49a80ce7937c41268bb7c9339fedca68"
format_stamp: "Formatted at 2026-08-12 11:06:06 on dist-test-slave-lgr5"
server_key: "bdc19e9b9410b47593e9273e2d383ede"
server_key_iv: "66688a16419f973333c7561170b0ec40"
server_key_version: "encryptionkey@0"
I20260812 11:06:06.290887 22135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "49a80ce7937c41268bb7c9339fedca68"
format_stamp: "Formatted at 2026-08-12 11:06:06 on dist-test-slave-lgr5"
server_key: "bdc19e9b9410b47593e9273e2d383ede"
server_key_iv: "66688a16419f973333c7561170b0ec40"
server_key_version: "encryptionkey@0"
I20260812 11:06:06.295092 22135 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260812 11:06:06.297910 22174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:06.299319 22135 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:06.299471 22135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "49a80ce7937c41268bb7c9339fedca68"
format_stamp: "Formatted at 2026-08-12 11:06:06 on dist-test-slave-lgr5"
server_key: "bdc19e9b9410b47593e9273e2d383ede"
server_key_iv: "66688a16419f973333c7561170b0ec40"
server_key_version: "encryptionkey@0"
I20260812 11:06:06.299657 22135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:06.317256 22135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:06.320362 22135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:06.320555 22135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:06.328866 22135 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:46841
I20260812 11:06:06.328884 22277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:46841 every 8 connection(s)
I20260812 11:06:06.329993 22135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:06.333155 22278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:06.338380 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 22135
I20260812 11:06:06.338483 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:06.338744 19131 external_mini_cluster.cc:1428] Setting key 97ebb4b1be3a9e5fb9c30d14071214f4
I20260812 11:06:06.339543 22278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68: Bootstrap starting.
I20260812 11:06:06.342352 22278 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:06.343283 22278 log.cc:824] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:06.345624 22278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68: No bootstrap required, opened a new log
Aug 12 11:06:06 dist-test-slave-lgr5 krb5kdc[22105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532766, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:06.349961 22278 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49a80ce7937c41268bb7c9339fedca68" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46841 } }
I20260812 11:06:06.350284 22278 raft_consensus.cc:374] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:06.350378 22278 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49a80ce7937c41268bb7c9339fedca68, State: Initialized, Role: FOLLOWER
I20260812 11:06:06.350932 22278 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49a80ce7937c41268bb7c9339fedca68" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46841 } }
I20260812 11:06:06.351109 22278 raft_consensus.cc:388] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:06.351181 22278 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:06.351284 22278 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:06.352257 22278 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49a80ce7937c41268bb7c9339fedca68" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46841 } }
I20260812 11:06:06.352620 22278 leader_election.cc:302] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49a80ce7937c41268bb7c9339fedca68; no voters:
I20260812 11:06:06.352953 22278 leader_election.cc:288] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:06.353065 22290 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:06.353312 22290 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [term 1 LEADER]: Becoming Leader. State: Replica: 49a80ce7937c41268bb7c9339fedca68, State: Running, Role: LEADER
I20260812 11:06:06.353699 22290 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49a80ce7937c41268bb7c9339fedca68" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46841 } }
I20260812 11:06:06.354207 22288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:06.340263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60608 (local address 127.18.174.254:46841)
0812 11:06:06.340747 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:06.340768 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:06.340814 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:06:06.341665 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:06.341690 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:06.342144 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:06.342547 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:06.343297 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.344676 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.345618 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.346341 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.346519 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:06.348929 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:06.348936 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:06.348957 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:06.349003 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:06.350946 (+ 1943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:06.351463 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:06.351469 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:06.351474 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:06.351606 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:06.351884 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:06.351887 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:06.351889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:06.352389 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:06.352586 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:06.352886 (+ 300us) server_negotiation.cc:299] Negotiation successful
0812 11:06:06.353266 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":126,"threads_started":1}
I20260812 11:06:06.354457 22278 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:06.355618 22294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49a80ce7937c41268bb7c9339fedca68. Latest consensus state: current_term: 1 leader_uuid: "49a80ce7937c41268bb7c9339fedca68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49a80ce7937c41268bb7c9339fedca68" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46841 } } }
I20260812 11:06:06.355619 22297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49a80ce7937c41268bb7c9339fedca68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49a80ce7937c41268bb7c9339fedca68" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46841 } } }
I20260812 11:06:06.355772 22294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:06.355772 22297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68 [sys.catalog]: This master's current role is: LEADER
W20260812 11:06:06.359305 22327 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:06:06.359382 22327 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:06:06.359549 22310 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:06.360601 22310 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:06.367034 22310 catalog_manager.cc:1347] Generated new cluster ID: 5591b6b18caf476196b283d49e450b7c
I20260812 11:06:06.367110 22310 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:06.384938 22310 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:06.385948 22310 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:06.398677 22310 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68: Generated new TSK 0
I20260812 11:06:06.399492 22310 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:06:06.436470 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46841
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:32849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:06.556253 22334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:06.556546 22334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:06.556612 22334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:06.560668 22334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:06.560734 22334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:06.560791 22334 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 11:06:06.560815 22334 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:06:06.560868 22334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:06.566269 22334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:32849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.174.254:46841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:06.567421 22334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:06.568526 22334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:06.578382 22348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:06.578397 22345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:06.578393 22342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:06.578922 22334 server_base.cc:1034] running on GCE node
I20260812 11:06:06.579344 22334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:06.580041 22334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:06.581236 22334 hybrid_clock.cc:648] HybridClock initialized: now 1786532766581199 us; error 48 us; skew 500 ppm
Aug 12 11:06:06 dist-test-slave-lgr5 krb5kdc[22105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532766, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:06.584041 22334 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:06:06.585011 22334 webserver.cc:460] Webserver started at http://127.18.174.193:45533/ using document root <none> and password file <none>
I20260812 11:06:06.585603 22334 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:06.585668 22334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:06.585884 22334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:06.588024 22334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "55c80a506afc4020b0f2ceee47204ff0"
format_stamp: "Formatted at 2026-08-12 11:06:06 on dist-test-slave-lgr5"
server_key: "9390caffcb33c6ae5f7afb708257961c"
server_key_iv: "d2c9bbc812aab4cd5e62e952b796a995"
server_key_version: "encryptionkey@0"
I20260812 11:06:06.588640 22334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "55c80a506afc4020b0f2ceee47204ff0"
format_stamp: "Formatted at 2026-08-12 11:06:06 on dist-test-slave-lgr5"
server_key: "9390caffcb33c6ae5f7afb708257961c"
server_key_iv: "d2c9bbc812aab4cd5e62e952b796a995"
server_key_version: "encryptionkey@0"
I20260812 11:06:06.592574 22334 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:06:06.595238 22363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:06.596599 22334 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:06.596712 22334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "55c80a506afc4020b0f2ceee47204ff0"
format_stamp: "Formatted at 2026-08-12 11:06:06 on dist-test-slave-lgr5"
server_key: "9390caffcb33c6ae5f7afb708257961c"
server_key_iv: "d2c9bbc812aab4cd5e62e952b796a995"
server_key_version: "encryptionkey@0"
I20260812 11:06:06.596835 22334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:06.621555 22334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:06.624915 22334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:06.625129 22334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:06.626786 22334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:06.626850 22334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:06.626894 22334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:06.626924 22334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:06:06 dist-test-slave-lgr5 krb5kdc[22105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532766, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:06.637375 22334 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:45537
I20260812 11:06:06.637593 22591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:45537 every 8 connection(s)
I20260812 11:06:06.638322 22334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:06:06.640010 22288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:06.627514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:54701 (local address 127.18.174.254:46841)
0812 11:06:06.627666 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:06.627671 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:06.628750 (+ 1079us) server_negotiation.cc:407] Connection header received
0812 11:06:06.629990 (+ 1240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:06.629994 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:06.630057 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:06.630151 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:06.631537 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.632171 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.633304 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.633603 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.633701 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:06.636284 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:06.636288 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:06.636291 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:06.636321 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:06.637844 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:06.638338 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:06.638342 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:06.638344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:06.638440 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:06.638761 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:06.638764 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:06.638766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:06.639001 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:06.639092 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:06.639692 (+ 600us) server_negotiation.cc:299] Negotiation successful
0812 11:06:06.639832 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:06:06.640830 22384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:06.627974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46841 (local address 127.18.174.193:54701)
0812 11:06:06.628554 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:06.628617 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:06.629722 (+ 1105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:06.630362 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:06.630373 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:06.630811 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:06.631375 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:06.631390 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.632284 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.632288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:06.633181 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:06.633191 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.633773 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.633777 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:06.633942 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:06.634546 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:06.634563 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:06.636071 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:06.637962 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:06.637969 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:06.637985 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:06.638241 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:06.638530 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:06.638533 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:06.638535 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:06.638671 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:06.639100 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:06.639128 (+ 28us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:06.639441 (+ 313us) client_negotiation.cc:769] Sending connection context
0812 11:06:06.639632 (+ 191us) client_negotiation.cc:240] Negotiation successful
0812 11:06:06.639960 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":125,"threads_started":1}
I20260812 11:06:06.642246 22592 heartbeater.cc:347] Connected to a master server at 127.18.174.254:46841
I20260812 11:06:06.642411 22592 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:06.642984 22592 heartbeater.cc:511] Master 127.18.174.254:46841 requested a full tablet report, sending...
I20260812 11:06:06.644783 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 22334
I20260812 11:06:06.644766 22203 ts_manager.cc:194] Registered new tserver with Master: 55c80a506afc4020b0f2ceee47204ff0 (127.18.174.193:45537)
I20260812 11:06:06.644924 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:06:06.645287 19131 external_mini_cluster.cc:1428] Setting key b9bae0d5e119ec847550d15aa87dbc36
I20260812 11:06:06.646194 22203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:54701
I20260812 11:06:06.652261 22607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:06.644346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46841 (local address 127.18.174.193:45581)
0812 11:06:06.644695 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:06.644709 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:06.644814 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:06.645198 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:06.645200 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:06.645428 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:06.645561 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:06.645569 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.646707 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.646711 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:06.647488 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:06.647500 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.648108 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.648112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:06.648203 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:06.648750 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:06.648761 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:06.649102 (+ 341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:06.650801 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:06.650804 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:06.650805 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:06.651009 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:06.651291 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:06.651293 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:06.651295 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:06.651363 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:06.651765 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:06.651767 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:06.651851 (+ 84us) client_negotiation.cc:769] Sending connection context
0812 11:06:06.651930 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 11:06:06.652050 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":111,"threads_started":1}
I20260812 11:06:06.652310 22288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:06.644449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:45581 (local address 127.18.174.254:46841)
0812 11:06:06.644577 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:06.644582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:06.644781 (+ 199us) server_negotiation.cc:407] Connection header received
0812 11:06:06.644934 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:06.644937 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:06.644990 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:06.645042 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:06.645864 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.646573 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.647623 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.647933 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.648048 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:06.649236 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:06.649240 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:06.649243 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:06.649268 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:06.650696 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:06.651098 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:06.651101 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:06.651103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:06.651205 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:06.651438 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:06.651441 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:06.651443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:06.651672 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:06.651773 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:06.652007 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 11:06:06.652156 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:06:06.675933 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46841
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:32849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:06.791606 22612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:06.791899 22612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:06.791947 22612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:06.796154 22612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:06.796252 22612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:06.796308 22612 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 11:06:06.796334 22612 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:06:06.796377 22612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:06:06.802122 22612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:32849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.174.254:46841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:06.803354 22612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:06.804549 22612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:06.814949 22623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:06.814954 22627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:06.814951 22621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:06.815140 22612 server_base.cc:1034] running on GCE node
I20260812 11:06:06.815659 22612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:06.816370 22612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:06.817541 22612 hybrid_clock.cc:648] HybridClock initialized: now 1786532766817514 us; error 40 us; skew 500 ppm
Aug 12 11:06:06 dist-test-slave-lgr5 krb5kdc[22105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532766, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:06.820405 22612 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:06:06.821374 22612 webserver.cc:460] Webserver started at http://127.18.174.194:34821/ using document root <none> and password file <none>
I20260812 11:06:06.821959 22612 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:06.822031 22612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:06.822255 22612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:06.824424 22612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "ff17e46404ca467396c4957a9d8106ca"
format_stamp: "Formatted at 2026-08-12 11:06:06 on dist-test-slave-lgr5"
server_key: "2d414ef521a9a74e2bebe095756f6357"
server_key_iv: "e721f13401edacdff2d956ebb5ecf0d0"
server_key_version: "encryptionkey@0"
I20260812 11:06:06.824993 22612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "ff17e46404ca467396c4957a9d8106ca"
format_stamp: "Formatted at 2026-08-12 11:06:06 on dist-test-slave-lgr5"
server_key: "2d414ef521a9a74e2bebe095756f6357"
server_key_iv: "e721f13401edacdff2d956ebb5ecf0d0"
server_key_version: "encryptionkey@0"
I20260812 11:06:06.828819 22612 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:06:06.831393 22642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:06.832756 22612 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:06.832881 22612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "ff17e46404ca467396c4957a9d8106ca"
format_stamp: "Formatted at 2026-08-12 11:06:06 on dist-test-slave-lgr5"
server_key: "2d414ef521a9a74e2bebe095756f6357"
server_key_iv: "e721f13401edacdff2d956ebb5ecf0d0"
server_key_version: "encryptionkey@0"
I20260812 11:06:06.832998 22612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:06.858999 22612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:06.862514 22612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:06.862709 22612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:06.864328 22612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:06.864385 22612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:06.864442 22612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:06.864477 22612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:06:06 dist-test-slave-lgr5 krb5kdc[22105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532766, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:06.875284 22612 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:41297
I20260812 11:06:06.875303 22859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:41297 every 8 connection(s)
I20260812 11:06:06.876528 22612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:06:06.878067 22288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:06.865116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:44899 (local address 127.18.174.254:46841)
0812 11:06:06.865235 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:06.865239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:06.866358 (+ 1119us) server_negotiation.cc:407] Connection header received
0812 11:06:06.867437 (+ 1079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:06.867441 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:06.867509 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:06.867570 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:06.869085 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.869646 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.870839 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.871060 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.871155 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:06.874222 (+ 3067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:06.874225 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:06.874228 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:06.874255 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:06.875838 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:06.876393 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:06.876398 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:06.876399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:06.876506 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:06.876909 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:06.876913 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:06.876915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:06.877176 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:06.877276 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:06.877818 (+ 542us) server_negotiation.cc:299] Negotiation successful
0812 11:06:06.877943 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:06:06.878818 22656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:06.865679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46841 (local address 127.18.174.194:44899)
0812 11:06:06.866199 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:06.866243 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:06.867142 (+ 899us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:06.867928 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:06.867935 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:06.868326 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:06.868927 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:06.868947 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.869778 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.869782 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:06.870700 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:06.870711 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.871298 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.871302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:06.871476 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:06.872157 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:06.872181 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:06.874034 (+ 1853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:06.875960 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:06.875965 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:06.875978 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:06.876290 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:06.876614 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:06.876618 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:06.876620 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:06.876793 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:06.877331 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:06.877338 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:06.877582 (+ 244us) client_negotiation.cc:769] Sending connection context
0812 11:06:06.877737 (+ 155us) client_negotiation.cc:240] Negotiation successful
0812 11:06:06.878012 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":149,"threads_started":1}
I20260812 11:06:06.879954 22860 heartbeater.cc:347] Connected to a master server at 127.18.174.254:46841
I20260812 11:06:06.880133 22860 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:06.880713 22860 heartbeater.cc:511] Master 127.18.174.254:46841 requested a full tablet report, sending...
I20260812 11:06:06.881805 22204 ts_manager.cc:194] Registered new tserver with Master: ff17e46404ca467396c4957a9d8106ca (127.18.174.194:41297)
I20260812 11:06:06.882566 22204 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:44899
I20260812 11:06:06.883606 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 22612
I20260812 11:06:06.883711 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:06:06.884022 19131 external_mini_cluster.cc:1428] Setting key 076b64df0b838d6401c1cabf5f45497d
I20260812 11:06:06.888994 22288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:06.882313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:55593 (local address 127.18.174.254:46841)
0812 11:06:06.882420 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:06.882424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:06.882614 (+ 190us) server_negotiation.cc:407] Connection header received
0812 11:06:06.882729 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:06.882732 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:06.882777 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:06.882856 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:06.883328 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.883888 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.884863 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.885070 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.885159 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:06.886259 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:06.886263 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:06.886266 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:06.886291 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:06.887428 (+ 1137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:06.887819 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:06.887822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:06.887824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:06.887900 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:06.888178 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:06.888182 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:06.888184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:06.888401 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:06.888498 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:06.888742 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 11:06:06.888850 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 11:06:06.889017 22869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:06.882258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46841 (local address 127.18.174.194:55593)
0812 11:06:06.882539 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:06.882550 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:06.882641 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:06.882893 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:06.882896 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:06.883084 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:06.883215 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:06.883222 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.884036 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.884039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:06.884759 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:06.884771 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:06.885179 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:06.885183 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:06.885273 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:06.885793 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:06.885804 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:06.886126 (+ 322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:06.887535 (+ 1409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:06.887538 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:06.887541 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:06.887732 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:06.887991 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:06.887994 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:06.887996 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:06.888073 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:06.888495 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:06.888498 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:06.888589 (+ 91us) client_negotiation.cc:769] Sending connection context
0812 11:06:06.888675 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 11:06:06.888819 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":126,"threads_started":1}
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:06:06.915835 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46841
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:32849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:07.035930 22877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:07.036248 22877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:07.036319 22877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:07.040488 22877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:07.040567 22877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:07.040627 22877 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 11:06:07.040653 22877 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:06:07.040702 22877 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:06:07.046335 22877 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:32849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.174.254:46841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:07.047499 22877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:07.048601 22877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:07.058895 22885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:07.058877 22883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:07.058930 22877 server_base.cc:1034] running on GCE node
W20260812 11:06:07.058877 22890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:07.059617 22877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:07.060343 22877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:07.061508 22877 hybrid_clock.cc:648] HybridClock initialized: now 1786532767061486 us; error 35 us; skew 500 ppm
Aug 12 11:06:07 dist-test-slave-lgr5 krb5kdc[22105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532767, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:07.064393 22877 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:06:07.065394 22877 webserver.cc:460] Webserver started at http://127.18.174.195:41869/ using document root <none> and password file <none>
I20260812 11:06:07.066005 22877 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:07.066077 22877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:07.066298 22877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:07.068517 22877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "e3785605fde741a68bcdee9e9659048e"
format_stamp: "Formatted at 2026-08-12 11:06:07 on dist-test-slave-lgr5"
server_key: "6992dce11597b6ca3b40a4ac533ac54d"
server_key_iv: "fbdd90886d3937e286239d4f9f0a81eb"
server_key_version: "encryptionkey@0"
I20260812 11:06:07.069092 22877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "e3785605fde741a68bcdee9e9659048e"
format_stamp: "Formatted at 2026-08-12 11:06:07 on dist-test-slave-lgr5"
server_key: "6992dce11597b6ca3b40a4ac533ac54d"
server_key_iv: "fbdd90886d3937e286239d4f9f0a81eb"
server_key_version: "encryptionkey@0"
I20260812 11:06:07.072988 22877 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:06:07.075609 22898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:07.076974 22877 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:07.077111 22877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "e3785605fde741a68bcdee9e9659048e"
format_stamp: "Formatted at 2026-08-12 11:06:07 on dist-test-slave-lgr5"
server_key: "6992dce11597b6ca3b40a4ac533ac54d"
server_key_iv: "fbdd90886d3937e286239d4f9f0a81eb"
server_key_version: "encryptionkey@0"
I20260812 11:06:07.077226 22877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:07.094713 22877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:07.097718 22877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:07.097908 22877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:07.099458 22877 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:07.099516 22877 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:07.099577 22877 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:07.099601 22877 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:06:07 dist-test-slave-lgr5 krb5kdc[22105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532767, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:07.110630 22877 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:43799
I20260812 11:06:07.110888 23132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:43799 every 8 connection(s)
I20260812 11:06:07.111718 22877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:06:07.113584 22288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.100304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:54549 (local address 127.18.174.254:46841)
0812 11:06:07.100443 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:07.100449 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:07.101542 (+ 1093us) server_negotiation.cc:407] Connection header received
0812 11:06:07.102593 (+ 1051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:07.102597 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:07.102657 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:07.102716 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:07.104419 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.105081 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.106261 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.106519 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.106614 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.109638 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:07.109641 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:07.109643 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:07.109672 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:07.111358 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:07.111963 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:07.111966 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:07.111967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:07.112054 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:07.112468 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:07.112472 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:07.112474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:07.112742 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:07.112843 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:07.113330 (+ 487us) server_negotiation.cc:299] Negotiation successful
0812 11:06:07.113440 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:06:07.113649 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 22877
I20260812 11:06:07.113758 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:06:07.114082 19131 external_mini_cluster.cc:1428] Setting key 43b8f6cb3fbd9ce0116a8e867910ef67
I20260812 11:06:07.114638 22912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.100847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46841 (local address 127.18.174.195:54549)
0812 11:06:07.101375 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:07.101422 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:07.102331 (+ 909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:07.103160 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:07.103166 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:07.103601 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:07.104268 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.104285 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.105213 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.105216 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.106131 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.106143 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.106695 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.106699 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.106877 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.107539 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:07.107556 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:07.109421 (+ 1865us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:07.111487 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:07.111494 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:07.111509 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:07.111859 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:07.112162 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:07.112166 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:07.112168 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:07.112343 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:07.112861 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:07.112866 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:07.113112 (+ 246us) client_negotiation.cc:769] Sending connection context
0812 11:06:07.113268 (+ 156us) client_negotiation.cc:240] Negotiation successful
0812 11:06:07.113628 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":143,"threads_started":1}
I20260812 11:06:07.115918 23133 heartbeater.cc:347] Connected to a master server at 127.18.174.254:46841
I20260812 11:06:07.116132 23133 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:07.116676 23133 heartbeater.cc:511] Master 127.18.174.254:46841 requested a full tablet report, sending...
I20260812 11:06:07.117669 22204 ts_manager.cc:194] Registered new tserver with Master: e3785605fde741a68bcdee9e9659048e (127.18.174.195:43799)
I20260812 11:06:07.118306 22204 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:54549
I20260812 11:06:07.124424 23145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.117958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46841 (local address 127.18.174.195:56703)
0812 11:06:07.118304 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:07.118315 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:07.118398 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:07.118866 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:07.118870 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:07.119104 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:07.119219 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.119227 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.119968 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.119972 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.120672 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.120681 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.121087 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.121090 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.121154 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.121637 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:07.121649 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:07.121954 (+ 305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:07.123252 (+ 1298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:07.123255 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:07.123257 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:07.123443 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:07.123640 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:07.123642 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:07.123643 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:07.123708 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:07.123975 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:07.123977 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:07.124058 (+ 81us) client_negotiation.cc:769] Sending connection context
0812 11:06:07.124169 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 11:06:07.124281 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":108,"threads_started":1}
I20260812 11:06:07.124429 22288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.118040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:56703 (local address 127.18.174.254:46841)
0812 11:06:07.118170 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:07.118174 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:07.118383 (+ 209us) server_negotiation.cc:407] Connection header received
0812 11:06:07.118460 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:07.118462 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:07.118515 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:07.118596 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:07.119346 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.119844 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.120779 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.121001 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.121080 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.122071 (+ 991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:07.122073 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:07.122075 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:07.122090 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:07.123160 (+ 1070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:07.123513 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:07.123515 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:07.123516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:07.123581 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:07.123764 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:07.123766 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:07.123767 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:07.123917 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:07.123994 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:07.124223 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 11:06:07.124318 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:06:07.129585 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:06:07 dist-test-slave-lgr5 krb5kdc[22105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:06:07 dist-test-slave-lgr5 krb5kdc[22105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:07.155803 22288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.147998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60620 (local address 127.18.174.254:46841)
0812 11:06:07.148148 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:07.148151 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:07.148164 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:06:07.148207 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:07.148210 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:07.148253 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:07.148317 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:07.148995 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.149504 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.150243 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.150442 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.150506 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.152921 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:07.152924 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:07.152926 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:07.152955 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:07.154139 (+ 1184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:07.154631 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:07.154636 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:07.154637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:07.154732 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:07.154944 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:07.154946 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:07.154947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:07.155192 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:07.155298 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:07.155549 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 11:06:07.155659 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:06:07.159026 22204 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60620:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:06:07.162191 22204 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:07.178160 23168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.171817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40354 (local address 127.18.174.194:41297)
0812 11:06:07.172806 (+ 989us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:07.172824 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:07.172853 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:06:07.172941 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:07.172946 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:07.173174 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:07.173341 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:07.173874 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.174990 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.176660 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.177407 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.177556 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.177761 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:07.177881 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 11:06:07.177993 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":867,"thread_start_us":168,"threads_started":1}
I20260812 11:06:07.178319 23177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.171906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:43799 (local address 127.0.0.1:37568)
0812 11:06:07.173086 (+ 1180us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:07.173102 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:07.173200 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:07.174216 (+ 1016us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:07.174219 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:07.174237 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:07.174328 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.174335 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.175554 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.175558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.176774 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.176783 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.177872 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.177876 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.177958 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.177990 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 11:06:07.178048 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 11:06:07.178184 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1114,"mutex_wait_us":38,"thread_start_us":83,"threads_started":1}
I20260812 11:06:07.178403 23185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.172609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37568 (local address 127.18.174.195:43799)
0812 11:06:07.173683 (+ 1074us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:07.173692 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:07.173710 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:06:07.173772 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:07.173775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:07.173953 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:07.174103 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:07.174449 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.175428 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.176901 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.177735 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.177905 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.178052 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:07.178109 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 11:06:07.178208 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":970,"thread_start_us":124,"threads_started":1}
I20260812 11:06:07.178689 23167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.171686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:45537 (local address 127.0.0.1:55312)
0812 11:06:07.173272 (+ 1586us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:07.173287 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:07.173375 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:07.173955 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:07.173959 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:07.173979 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:07.174079 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.174086 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.175589 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.175592 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.176949 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.176960 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.178247 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.178251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.178351 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.178379 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 11:06:07.178461 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 11:06:07.178542 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1510,"mutex_wait_us":878,"thread_start_us":114,"threads_started":1}
I20260812 11:06:07.179234 23176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.171951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55312 (local address 127.18.174.193:45537)
0812 11:06:07.173116 (+ 1165us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:07.173123 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:07.173361 (+ 238us) server_negotiation.cc:407] Connection header received
0812 11:06:07.173489 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:07.173495 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:07.173826 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:07.173979 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:07.174178 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.174989 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.177084 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.177930 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.178058 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.178176 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:07.178984 (+ 808us) server_negotiation.cc:299] Negotiation successful
0812 11:06:07.179093 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1046,"thread_start_us":141,"threads_started":1}
I20260812 11:06:07.178877 23174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.171686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:41297 (local address 127.0.0.1:40354)
0812 11:06:07.172564 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:07.172633 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:07.172798 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:07.173516 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:07.173522 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:07.173546 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:07.173734 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.173744 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.175128 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.175132 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.176477 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.176491 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.177538 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.177543 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.177668 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.177710 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 11:06:07.178707 (+ 997us) client_negotiation.cc:240] Negotiation successful
0812 11:06:07.178783 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"thread_start_us":107,"threads_started":1}
I20260812 11:06:07.181942 23000 tablet_service.cc:1467] Processing CreateTablet for tablet cb3ea87b04a94c229847e59a4c798618 (DEFAULT_TABLE table=test-table [id=661ddbd18636498683ac33434d9c7701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:07.182190 22725 tablet_service.cc:1467] Processing CreateTablet for tablet cb3ea87b04a94c229847e59a4c798618 (DEFAULT_TABLE table=test-table [id=661ddbd18636498683ac33434d9c7701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:07.182315 22466 tablet_service.cc:1467] Processing CreateTablet for tablet cb3ea87b04a94c229847e59a4c798618 (DEFAULT_TABLE table=test-table [id=661ddbd18636498683ac33434d9c7701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:07.183162 22725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb3ea87b04a94c229847e59a4c798618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:07.183171 23000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb3ea87b04a94c229847e59a4c798618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:07.183219 22466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb3ea87b04a94c229847e59a4c798618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:07.190258 23186 tablet_bootstrap.cc:492] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca: Bootstrap starting.
I20260812 11:06:07.191701 23187 tablet_bootstrap.cc:492] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e: Bootstrap starting.
I20260812 11:06:07.191753 23189 tablet_bootstrap.cc:492] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0: Bootstrap starting.
I20260812 11:06:07.193200 23186 tablet_bootstrap.cc:654] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:07.193588 23189 tablet_bootstrap.cc:654] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:07.193903 23187 tablet_bootstrap.cc:654] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:07.194216 23186 log.cc:824] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:07.194298 23189 log.cc:824] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:07.194711 23187 log.cc:824] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:07.196470 23189 tablet_bootstrap.cc:492] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0: No bootstrap required, opened a new log
I20260812 11:06:07.196674 23189 ts_tablet_manager.cc:1397] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:06:07.196749 23187 tablet_bootstrap.cc:492] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e: No bootstrap required, opened a new log
I20260812 11:06:07.196955 23187 ts_tablet_manager.cc:1397] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:06:07.197430 23186 tablet_bootstrap.cc:492] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca: No bootstrap required, opened a new log
I20260812 11:06:07.197623 23186 ts_tablet_manager.cc:1397] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260812 11:06:07.200300 23189 raft_consensus.cc:348] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.200546 23189 raft_consensus.cc:374] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:07.200599 23189 raft_consensus.cc:729] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55c80a506afc4020b0f2ceee47204ff0, State: Initialized, Role: FOLLOWER
I20260812 11:06:07.201028 23189 consensus_queue.cc:260] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.201025 23187 raft_consensus.cc:348] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.201324 23187 raft_consensus.cc:374] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:07.201391 23187 raft_consensus.cc:729] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3785605fde741a68bcdee9e9659048e, State: Initialized, Role: FOLLOWER
I20260812 11:06:07.201663 23186 raft_consensus.cc:348] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.201839 23187 consensus_queue.cc:260] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.201951 23186 raft_consensus.cc:374] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:07.201956 23189 ts_tablet_manager.cc:1428] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 11:06:07.202323 22592 heartbeater.cc:503] Master 127.18.174.254:46841 was elected leader, sending a full tablet report...
I20260812 11:06:07.202009 23186 raft_consensus.cc:729] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff17e46404ca467396c4957a9d8106ca, State: Initialized, Role: FOLLOWER
I20260812 11:06:07.202875 23187 ts_tablet_manager.cc:1428] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:06:07.203122 23186 consensus_queue.cc:260] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.203451 23133 heartbeater.cc:503] Master 127.18.174.254:46841 was elected leader, sending a full tablet report...
I20260812 11:06:07.204252 22860 heartbeater.cc:503] Master 127.18.174.254:46841 was elected leader, sending a full tablet report...
I20260812 11:06:07.204270 23186 ts_tablet_manager.cc:1428] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 11:06:07.346356 23204 raft_consensus.cc:482] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:07.346588 23204 raft_consensus.cc:504] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.347892 23204 leader_election.cc:288] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff17e46404ca467396c4957a9d8106ca (127.18.174.194:41297), 55c80a506afc4020b0f2ceee47204ff0 (127.18.174.193:45537)
I20260812 11:06:07.352440 23176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.348337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:42761 (local address 127.18.174.193:45537)
0812 11:06:07.348447 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:07.348451 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:07.348502 (+ 51us) server_negotiation.cc:407] Connection header received
0812 11:06:07.348570 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:07.348573 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:07.348625 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:07.348709 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:07.349009 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.349756 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.351207 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.351851 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.351992 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.352053 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:07.352255 (+ 202us) server_negotiation.cc:299] Negotiation successful
0812 11:06:07.352322 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:06:07.352473 22912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.348192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:45537 (local address 127.18.174.195:42761)
0812 11:06:07.348310 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:07.348325 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:07.348432 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:07.348736 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:07.348738 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:07.348758 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:07.348887 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.348895 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.349885 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.349888 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.351072 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.351083 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.351968 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.351979 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.352132 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.352160 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 11:06:07.352240 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 11:06:07.352320 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 11:06:07.353225 23168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.348273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:37481 (local address 127.18.174.194:41297)
0812 11:06:07.348402 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:07.348408 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:07.348820 (+ 412us) server_negotiation.cc:407] Connection header received
0812 11:06:07.348914 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:07.348917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:07.348969 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:07.349039 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:07.349995 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.350770 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.352042 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.352629 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.352752 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.352806 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:07.353057 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 11:06:07.353130 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:06:07.353251 23208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.348192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:41297 (local address 127.18.174.195:37481)
0812 11:06:07.348713 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:07.348728 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:07.348830 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:07.349059 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:07.349061 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:07.349093 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:07.349862 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.349874 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.350873 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.350875 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.351920 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.351931 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.352819 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.352824 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.352913 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.352935 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 11:06:07.353025 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 11:06:07.353094 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"mutex_wait_us":124,"thread_start_us":150,"threads_started":1}
I20260812 11:06:07.353255 22504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb3ea87b04a94c229847e59a4c798618" candidate_uuid: "e3785605fde741a68bcdee9e9659048e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c80a506afc4020b0f2ceee47204ff0" is_pre_election: true
I20260812 11:06:07.353639 22504 raft_consensus.cc:2454] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3785605fde741a68bcdee9e9659048e in term 0.
I20260812 11:06:07.353920 22764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb3ea87b04a94c229847e59a4c798618" candidate_uuid: "e3785605fde741a68bcdee9e9659048e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff17e46404ca467396c4957a9d8106ca" is_pre_election: true
I20260812 11:06:07.354200 22902 leader_election.cc:302] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55c80a506afc4020b0f2ceee47204ff0, e3785605fde741a68bcdee9e9659048e; no voters:
I20260812 11:06:07.354223 22764 raft_consensus.cc:2454] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3785605fde741a68bcdee9e9659048e in term 0.
I20260812 11:06:07.354499 23204 raft_consensus.cc:2781] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:07.354602 23204 raft_consensus.cc:482] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:07.354660 23204 raft_consensus.cc:3037] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:07.355872 23204 raft_consensus.cc:504] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.356287 23204 leader_election.cc:288] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [CANDIDATE]: Term 1 election: Requested vote from peers ff17e46404ca467396c4957a9d8106ca (127.18.174.194:41297), 55c80a506afc4020b0f2ceee47204ff0 (127.18.174.193:45537)
I20260812 11:06:07.356726 22504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb3ea87b04a94c229847e59a4c798618" candidate_uuid: "e3785605fde741a68bcdee9e9659048e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c80a506afc4020b0f2ceee47204ff0"
I20260812 11:06:07.356726 22764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb3ea87b04a94c229847e59a4c798618" candidate_uuid: "e3785605fde741a68bcdee9e9659048e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff17e46404ca467396c4957a9d8106ca"
I20260812 11:06:07.356877 22764 raft_consensus.cc:3037] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:07.356877 22504 raft_consensus.cc:3037] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:07.358286 22764 raft_consensus.cc:2454] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3785605fde741a68bcdee9e9659048e in term 1.
I20260812 11:06:07.358286 22504 raft_consensus.cc:2454] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3785605fde741a68bcdee9e9659048e in term 1.
I20260812 11:06:07.358671 22902 leader_election.cc:302] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55c80a506afc4020b0f2ceee47204ff0, e3785605fde741a68bcdee9e9659048e; no voters:
I20260812 11:06:07.358863 23204 raft_consensus.cc:2781] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:07.359102 23204 raft_consensus.cc:686] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [term 1 LEADER]: Becoming Leader. State: Replica: e3785605fde741a68bcdee9e9659048e, State: Running, Role: LEADER
I20260812 11:06:07.359453 23204 consensus_queue.cc:237] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
W20260812 11:06:07.362880 23135 tablet.cc:2369] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:06:07.363013 22204 catalog_manager.cc:5495] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e reported cstate change: term changed from 0 to 1, leader changed from <none> to e3785605fde741a68bcdee9e9659048e (127.18.174.195). New cstate: current_term: 1 leader_uuid: "e3785605fde741a68bcdee9e9659048e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } health_report { overall_health: HEALTHY } } }
W20260812 11:06:07.377760 22861 tablet.cc:2369] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:06:07.389932 22597 tablet.cc:2369] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 11:06:07 dist-test-slave-lgr5 krb5kdc[22105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532766, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:07.453912 23217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.446021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46841 (local address 127.0.0.1:60628)
0812 11:06:07.446313 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:07.446330 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:07.446476 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:07.446713 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:07.446715 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:07.447152 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:07.447256 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.447263 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.447992 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.447994 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.448598 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.448607 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.449014 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.449016 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.449077 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.449639 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:07.449651 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:07.451078 (+ 1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:07.452544 (+ 1466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:07.452555 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:07.452560 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:07.452804 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:07.453014 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:07.453016 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:07.453017 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:07.453089 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:07.453390 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:07.453396 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:07.453506 (+ 110us) client_negotiation.cc:769] Sending connection context
0812 11:06:07.453592 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 11:06:07.453725 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":115,"threads_started":1}
I20260812 11:06:07.453915 22288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.446066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60628 (local address 127.18.174.254:46841)
0812 11:06:07.446204 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:07.446209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:07.446421 (+ 212us) server_negotiation.cc:407] Connection header received
0812 11:06:07.446558 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:07.446565 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:07.446611 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:07.446681 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:07.447371 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.447901 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.448705 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.448917 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.448996 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.451212 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:07.451216 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:07.451218 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:07.451242 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:07.452429 (+ 1187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:07.452878 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:07.452880 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:07.452882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:07.452951 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:07.453146 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:07.453148 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:07.453149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:07.453320 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:07.453389 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:07.453639 (+ 250us) server_negotiation.cc:299] Negotiation successful
0812 11:06:07.453785 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":50}
I20260812 11:06:07.458161 22204 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:60628:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 11:06:07.458866 22204 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:07.464047 22466 tablet_service.cc:1467] Processing CreateTablet for tablet 3e26134c2ac5429590d213263b74c6df (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5675089746b546c79fdde46afa7764a7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:06:07.464046 22725 tablet_service.cc:1467] Processing CreateTablet for tablet 3e26134c2ac5429590d213263b74c6df (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5675089746b546c79fdde46afa7764a7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:06:07.464063 23000 tablet_service.cc:1467] Processing CreateTablet for tablet 3e26134c2ac5429590d213263b74c6df (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5675089746b546c79fdde46afa7764a7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:06:07.464821 22466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e26134c2ac5429590d213263b74c6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:07.464824 22725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e26134c2ac5429590d213263b74c6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:07.464824 23000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e26134c2ac5429590d213263b74c6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:07.467321 23189 tablet_bootstrap.cc:492] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0: Bootstrap starting.
I20260812 11:06:07.467753 23187 tablet_bootstrap.cc:492] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e: Bootstrap starting.
I20260812 11:06:07.468242 23186 tablet_bootstrap.cc:492] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca: Bootstrap starting.
I20260812 11:06:07.468374 23189 tablet_bootstrap.cc:654] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:07.468761 23187 tablet_bootstrap.cc:654] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:07.469089 23186 tablet_bootstrap.cc:654] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:07.469877 23189 tablet_bootstrap.cc:492] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0: No bootstrap required, opened a new log
I20260812 11:06:07.469969 23189 ts_tablet_manager.cc:1397] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:07.470075 23187 tablet_bootstrap.cc:492] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e: No bootstrap required, opened a new log
I20260812 11:06:07.470163 23187 ts_tablet_manager.cc:1397] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:06:07.470281 23186 tablet_bootstrap.cc:492] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca: No bootstrap required, opened a new log
I20260812 11:06:07.470355 23186 ts_tablet_manager.cc:1397] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:06:07.470459 23189 raft_consensus.cc:348] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.470589 23189 raft_consensus.cc:374] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:07.470628 23189 raft_consensus.cc:729] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55c80a506afc4020b0f2ceee47204ff0, State: Initialized, Role: FOLLOWER
I20260812 11:06:07.470605 23187 raft_consensus.cc:348] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.470724 23187 raft_consensus.cc:374] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:07.470762 23187 raft_consensus.cc:729] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3785605fde741a68bcdee9e9659048e, State: Initialized, Role: FOLLOWER
I20260812 11:06:07.470788 23189 consensus_queue.cc:260] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.470808 23186 raft_consensus.cc:348] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.470896 23186 raft_consensus.cc:374] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:07.470933 23186 raft_consensus.cc:729] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff17e46404ca467396c4957a9d8106ca, State: Initialized, Role: FOLLOWER
I20260812 11:06:07.470892 23187 consensus_queue.cc:260] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.471063 23186 consensus_queue.cc:260] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.471100 23201 raft_consensus.cc:482] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:07.471189 23189 ts_tablet_manager.cc:1428] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 11:06:07.471319 23186 ts_tablet_manager.cc:1428] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:07.471822 23207 tablet_replica.cc:439] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } } }
I20260812 11:06:07.471961 23207 tablet_replica.cc:442] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:07.471189 23201 raft_consensus.cc:504] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.473327 23201 leader_election.cc:288] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff17e46404ca467396c4957a9d8106ca (127.18.174.194:41297), e3785605fde741a68bcdee9e9659048e (127.18.174.195:43799)
I20260812 11:06:07.473846 23223 tablet_replica.cc:439] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } } }
I20260812 11:06:07.474295 23187 ts_tablet_manager.cc:1428] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260812 11:06:07.474253 23204 tablet_replica.cc:439] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } } }
I20260812 11:06:07.474387 23204 tablet_replica.cc:442] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:07.474125 23223 tablet_replica.cc:442] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:07.479817 23185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.473960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:43185 (local address 127.18.174.195:43799)
0812 11:06:07.474082 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:07.474087 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:07.475416 (+ 1329us) server_negotiation.cc:407] Connection header received
0812 11:06:07.475592 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:07.475595 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:07.475642 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:07.475711 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:07.475984 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.476741 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.478557 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.479187 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.479326 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.479368 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:07.479596 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 11:06:07.479690 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:06:07.479821 23168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.473947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:36467 (local address 127.18.174.194:41297)
0812 11:06:07.474082 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:07.474087 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:07.474643 (+ 556us) server_negotiation.cc:407] Connection header received
0812 11:06:07.474838 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:07.474841 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:07.474889 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:07.474986 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:07.475910 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.476741 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.478562 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.479187 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.479309 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.479368 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:07.479628 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 11:06:07.479716 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:06:07.479841 23228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.473609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:43799 (local address 127.18.174.193:43185)
0812 11:06:07.475322 (+ 1713us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:07.475336 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:07.475487 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:07.475726 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:07.475729 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:07.475746 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:07.475859 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.475866 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.476883 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.476886 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.478419 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.478431 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.479338 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.479342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.479458 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.479502 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 11:06:07.479574 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 11:06:07.479655 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1644,"mutex_wait_us":101,"thread_start_us":119,"threads_started":1}
I20260812 11:06:07.480288 23227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.473598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:41297 (local address 127.18.174.193:36467)
0812 11:06:07.474556 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:07.474571 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:07.474718 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:07.475020 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:07.475023 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:07.475046 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:07.475782 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.475792 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.476883 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.476886 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.478419 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.478431 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.479373 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.479379 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.479460 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.479498 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 11:06:07.480049 (+ 551us) client_negotiation.cc:240] Negotiation successful
0812 11:06:07.480152 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":872,"mutex_wait_us":153,"thread_start_us":112,"threads_started":1}
I20260812 11:06:07.480743 22764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e26134c2ac5429590d213263b74c6df" candidate_uuid: "55c80a506afc4020b0f2ceee47204ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff17e46404ca467396c4957a9d8106ca" is_pre_election: true
I20260812 11:06:07.480772 23044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e26134c2ac5429590d213263b74c6df" candidate_uuid: "55c80a506afc4020b0f2ceee47204ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3785605fde741a68bcdee9e9659048e" is_pre_election: true
I20260812 11:06:07.480891 22764 raft_consensus.cc:2454] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55c80a506afc4020b0f2ceee47204ff0 in term 0.
I20260812 11:06:07.480997 23044 raft_consensus.cc:2454] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55c80a506afc4020b0f2ceee47204ff0 in term 0.
I20260812 11:06:07.481240 22369 leader_election.cc:302] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55c80a506afc4020b0f2ceee47204ff0, ff17e46404ca467396c4957a9d8106ca; no voters:
I20260812 11:06:07.481508 23223 raft_consensus.cc:2781] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:07.481575 23223 raft_consensus.cc:482] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:07.481618 23223 raft_consensus.cc:3037] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:07.482685 23223 raft_consensus.cc:504] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.483031 23223 leader_election.cc:288] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [CANDIDATE]: Term 1 election: Requested vote from peers ff17e46404ca467396c4957a9d8106ca (127.18.174.194:41297), e3785605fde741a68bcdee9e9659048e (127.18.174.195:43799)
I20260812 11:06:07.483500 22764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e26134c2ac5429590d213263b74c6df" candidate_uuid: "55c80a506afc4020b0f2ceee47204ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff17e46404ca467396c4957a9d8106ca"
I20260812 11:06:07.483637 22764 raft_consensus.cc:3037] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:07.484345 23044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e26134c2ac5429590d213263b74c6df" candidate_uuid: "55c80a506afc4020b0f2ceee47204ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3785605fde741a68bcdee9e9659048e"
I20260812 11:06:07.484467 23044 raft_consensus.cc:3037] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:07.484880 22764 raft_consensus.cc:2454] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55c80a506afc4020b0f2ceee47204ff0 in term 1.
I20260812 11:06:07.485165 22369 leader_election.cc:302] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55c80a506afc4020b0f2ceee47204ff0, ff17e46404ca467396c4957a9d8106ca; no voters:
I20260812 11:06:07.485348 23223 raft_consensus.cc:2781] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:07.485466 23223 raft_consensus.cc:686] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [term 1 LEADER]: Becoming Leader. State: Replica: 55c80a506afc4020b0f2ceee47204ff0, State: Running, Role: LEADER
I20260812 11:06:07.485617 23044 raft_consensus.cc:2454] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55c80a506afc4020b0f2ceee47204ff0 in term 1.
I20260812 11:06:07.486014 23223 consensus_queue.cc:237] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.487735 23201 tablet_replica.cc:439] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0: TxnStatusTablet state changed. Reason: New leader 55c80a506afc4020b0f2ceee47204ff0. Latest consensus state: current_term: 1 leader_uuid: "55c80a506afc4020b0f2ceee47204ff0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } } }
I20260812 11:06:07.487848 23201 tablet_replica.cc:442] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:06:07.488473 23232 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 11:06:07.488694 23232 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 11:06:07.489090 22204 catalog_manager.cc:5495] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55c80a506afc4020b0f2ceee47204ff0 (127.18.174.193). New cstate: current_term: 1 leader_uuid: "55c80a506afc4020b0f2ceee47204ff0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260812 11:06:07.505540 23176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.501416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55318 (local address 127.18.174.193:45537)
0812 11:06:07.501560 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:07.501564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:07.501578 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:06:07.501780 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:07.501782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:07.501840 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:07.501917 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:07.502181 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.502721 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.503966 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.504273 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.504361 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.504696 (+ 335us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:07.505174 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:07.505265 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:07.505358 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 11:06:07.505414 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:06:07.505594 23217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.501320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:45537 (local address 127.0.0.1:55318)
0812 11:06:07.501485 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:07.501502 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:07.501613 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:07.501946 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:07.501949 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:07.501957 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:06:07.502075 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.502082 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.502824 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.502827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.503837 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.503850 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.504379 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.504383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.504482 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.504549 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:06:07.505258 (+ 709us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:06:07.505270 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 11:06:07.505338 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 11:06:07.505443 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 11:06:07.511543 23044 raft_consensus.cc:1261] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Refusing update from remote peer 55c80a506afc4020b0f2ceee47204ff0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:07.511565 22764 raft_consensus.cc:1261] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Refusing update from remote peer 55c80a506afc4020b0f2ceee47204ff0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:07.512295 23223 consensus_queue.cc:1035] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:07.512501 23201 consensus_queue.cc:1035] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:07.516425 23204 tablet_replica.cc:439] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e: TxnStatusTablet state changed. Reason: New leader 55c80a506afc4020b0f2ceee47204ff0. Latest consensus state: current_term: 1 leader_uuid: "55c80a506afc4020b0f2ceee47204ff0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } } }
I20260812 11:06:07.516566 23204 tablet_replica.cc:442] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:07.516680 23207 tablet_replica.cc:439] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca: TxnStatusTablet state changed. Reason: New leader 55c80a506afc4020b0f2ceee47204ff0. Latest consensus state: current_term: 1 leader_uuid: "55c80a506afc4020b0f2ceee47204ff0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } } }
I20260812 11:06:07.516798 23207 tablet_replica.cc:442] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:07.520378 23223 tablet_replica.cc:439] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "55c80a506afc4020b0f2ceee47204ff0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } } }
I20260812 11:06:07.520373 23204 tablet_replica.cc:439] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "55c80a506afc4020b0f2ceee47204ff0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } } }
I20260812 11:06:07.520514 23223 tablet_replica.cc:442] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:06:07.520514 23204 tablet_replica.cc:442] T 3e26134c2ac5429590d213263b74c6df P e3785605fde741a68bcdee9e9659048e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:07.521292 23244 tablet_replica.cc:439] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "55c80a506afc4020b0f2ceee47204ff0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } } }
I20260812 11:06:07.521469 23244 tablet_replica.cc:442] T 3e26134c2ac5429590d213263b74c6df P 55c80a506afc4020b0f2ceee47204ff0: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:06:07.521891 23207 tablet_replica.cc:439] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "55c80a506afc4020b0f2ceee47204ff0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } } }
I20260812 11:06:07.522033 23207 tablet_replica.cc:442] T 3e26134c2ac5429590d213263b74c6df P ff17e46404ca467396c4957a9d8106ca: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:07.523541 23240 mvcc.cc:205] Tried to move back new op lower bound from 7317638215719182336 to 7317638215625342976. Current Snapshot: MvccSnapshot[applied={T|T < 7317638215719182336}]
I20260812 11:06:07.529807 23241 mvcc.cc:205] Tried to move back new op lower bound from 7317638215719182336 to 7317638215625342976. Current Snapshot: MvccSnapshot[applied={T|T < 7317638215719182336}]
I20260812 11:06:07.531630 23185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.527712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37584 (local address 127.18.174.195:43799)
0812 11:06:07.527838 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:07.527842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:07.527865 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:06:07.527977 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:07.527980 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:07.528047 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:07.528179 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:07.528426 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.529153 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.530147 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.530390 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.530482 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.530770 (+ 288us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:07.531259 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:07.531362 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:07.531437 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 11:06:07.531494 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:06:07.543411 23176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.539917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:39531 (local address 127.18.174.193:45537)
0812 11:06:07.540059 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:07.540064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:07.540105 (+ 41us) server_negotiation.cc:407] Connection header received
0812 11:06:07.540249 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:07.540252 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:07.540302 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:07.540366 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:07.540622 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.541215 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.542138 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.542358 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.542436 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.542902 (+ 466us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:07.542993 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:07.543065 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:07.543206 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 11:06:07.543277 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:06:07.543437 23145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.539792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:45537 (local address 127.18.174.195:39531)
0812 11:06:07.539962 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:07.539997 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:07.540144 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:07.540388 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:07.540391 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:07.540400 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:06:07.540516 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.540522 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.541335 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.541339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.541980 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.541991 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.542481 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.542485 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.542606 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.542674 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:06:07.543084 (+ 410us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:06:07.543090 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:06:07.543178 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 11:06:07.543280 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 11:06:07.552995 22764 raft_consensus.cc:1261] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Refusing update from remote peer e3785605fde741a68bcdee9e9659048e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:07.553150 22504 raft_consensus.cc:1261] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Refusing update from remote peer e3785605fde741a68bcdee9e9659048e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:07.553558 23204 consensus_queue.cc:1035] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:07.554060 23209 consensus_queue.cc:1035] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [LEADER]: Connected to new peer: Peer: permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:07.567476 23239 mvcc.cc:205] Tried to move back new op lower bound from 7317638215892008960 to 7317638215107547136. Current Snapshot: MvccSnapshot[applied={T|T < 7317638215892008960}]
I20260812 11:06:07.579133 23185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.575198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:49569 (local address 127.18.174.195:43799)
0812 11:06:07.575314 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:07.575318 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:07.575335 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:06:07.575485 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:07.575489 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:07.575550 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:07.575625 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:07.575897 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.576611 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.578065 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.578307 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.578403 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.578725 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:07.578804 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:07.578856 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:07.578960 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 11:06:07.579014 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:06:07.579206 23268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:07.574847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:43799 (local address 127.18.174.193:49569)
0812 11:06:07.575220 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:07.575235 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:07.575329 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:07.575643 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:07.575647 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:07.575655 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:06:07.575786 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.575792 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.576721 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.576725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.577909 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:07.577924 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:07.578423 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:07.578427 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:07.578530 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:07.578597 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:06:07.578881 (+ 284us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:06:07.578887 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:06:07.578947 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 11:06:07.579037 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":135,"threads_started":1}
I20260812 11:06:07.609930 22200 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:07.610177 22200 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:07.613402 22200 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68: Sending DeleteTablet for 3 replicas of tablet cb3ea87b04a94c229847e59a4c798618
I20260812 11:06:07.614564 22725 tablet_service.cc:1514] Processing DeleteTablet for tablet cb3ea87b04a94c229847e59a4c798618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:07 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:40354
I20260812 11:06:07.614704 22466 tablet_service.cc:1514] Processing DeleteTablet for tablet cb3ea87b04a94c229847e59a4c798618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:07 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:55312
I20260812 11:06:07.615254 23273 tablet_replica.cc:330] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca: stopping tablet replica
I20260812 11:06:07.615622 23273 raft_consensus.cc:2229] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:07.615890 23273 raft_consensus.cc:2258] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:07.616127 23000 tablet_service.cc:1514] Processing DeleteTablet for tablet cb3ea87b04a94c229847e59a4c798618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:07 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:37568
I20260812 11:06:07.616860 23280 tablet_replica.cc:330] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e: stopping tablet replica
I20260812 11:06:07.617195 23280 raft_consensus.cc:2229] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:06:07.617173 22200 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60620:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 11:06:07.617599 23280 raft_consensus.cc:2258] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 11:06:07.617658 22200 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:07.618232 23273 ts_tablet_manager.cc:1905] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:07.619012 23280 ts_tablet_manager.cc:1905] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:07.619490 23276 tablet_replica.cc:330] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0: stopping tablet replica
I20260812 11:06:07.619892 23276 raft_consensus.cc:2229] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:07.620165 23276 raft_consensus.cc:2258] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:07.621711 23273 ts_tablet_manager.cc:1918] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:06:07.621829 23273 log.cc:1196] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/cb3ea87b04a94c229847e59a4c798618
I20260812 11:06:07.622187 23273 ts_tablet_manager.cc:1939] T cb3ea87b04a94c229847e59a4c798618 P ff17e46404ca467396c4957a9d8106ca: Deleting consensus metadata
I20260812 11:06:07.623745 23280 ts_tablet_manager.cc:1918] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:06:07.623849 23280 log.cc:1196] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/cb3ea87b04a94c229847e59a4c798618
I20260812 11:06:07.623966 22175 catalog_manager.cc:4841] TS ff17e46404ca467396c4957a9d8106ca (127.18.174.194:41297): tablet cb3ea87b04a94c229847e59a4c798618 (table test-table [id=661ddbd18636498683ac33434d9c7701]) successfully deleted
I20260812 11:06:07.624195 23280 ts_tablet_manager.cc:1939] T cb3ea87b04a94c229847e59a4c798618 P e3785605fde741a68bcdee9e9659048e: Deleting consensus metadata
I20260812 11:06:07.624554 22466 tablet_service.cc:1467] Processing CreateTablet for tablet 47c9caffa66b4931b4a5ca1d3c654340 (DEFAULT_TABLE table=test-table [id=802c63c518c94571b7686107886d2a4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:07.624881 22466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47c9caffa66b4931b4a5ca1d3c654340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:07.627532 23189 tablet_bootstrap.cc:492] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0: Bootstrap starting.
I20260812 11:06:07.628651 23189 tablet_bootstrap.cc:654] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:07.629532 22179 catalog_manager.cc:4841] TS e3785605fde741a68bcdee9e9659048e (127.18.174.195:43799): tablet cb3ea87b04a94c229847e59a4c798618 (table test-table [id=661ddbd18636498683ac33434d9c7701]) successfully deleted
I20260812 11:06:07.629530 22725 tablet_service.cc:1467] Processing CreateTablet for tablet 47c9caffa66b4931b4a5ca1d3c654340 (DEFAULT_TABLE table=test-table [id=802c63c518c94571b7686107886d2a4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:07.629829 22725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47c9caffa66b4931b4a5ca1d3c654340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:07.630125 23000 tablet_service.cc:1467] Processing CreateTablet for tablet 47c9caffa66b4931b4a5ca1d3c654340 (DEFAULT_TABLE table=test-table [id=802c63c518c94571b7686107886d2a4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:07.630398 23000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47c9caffa66b4931b4a5ca1d3c654340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:07.632426 23186 tablet_bootstrap.cc:492] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca: Bootstrap starting.
I20260812 11:06:07.633013 23187 tablet_bootstrap.cc:492] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e: Bootstrap starting.
I20260812 11:06:07.633440 23186 tablet_bootstrap.cc:654] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:07.633982 23187 tablet_bootstrap.cc:654] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:07.635135 23186 tablet_bootstrap.cc:492] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca: No bootstrap required, opened a new log
I20260812 11:06:07.635234 23186 ts_tablet_manager.cc:1397] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:07.635691 23186 raft_consensus.cc:348] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.635818 23186 raft_consensus.cc:374] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:07.635847 23186 raft_consensus.cc:729] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff17e46404ca467396c4957a9d8106ca, State: Initialized, Role: FOLLOWER
I20260812 11:06:07.635987 23186 consensus_queue.cc:260] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.636293 23186 ts_tablet_manager.cc:1428] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 11:06:07.639340 23189 tablet_bootstrap.cc:492] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0: No bootstrap required, opened a new log
I20260812 11:06:07.639454 23189 ts_tablet_manager.cc:1397] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260812 11:06:07.639922 23189 raft_consensus.cc:348] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.640060 23189 raft_consensus.cc:374] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:07.640146 23189 raft_consensus.cc:729] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55c80a506afc4020b0f2ceee47204ff0, State: Initialized, Role: FOLLOWER
I20260812 11:06:07.640285 23189 consensus_queue.cc:260] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.640555 23189 ts_tablet_manager.cc:1428] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:07.653710 23187 tablet_bootstrap.cc:492] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e: No bootstrap required, opened a new log
I20260812 11:06:07.653851 23187 ts_tablet_manager.cc:1397] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20260812 11:06:07.654450 23187 raft_consensus.cc:348] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.654582 23187 raft_consensus.cc:374] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:07.654610 23187 raft_consensus.cc:729] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3785605fde741a68bcdee9e9659048e, State: Initialized, Role: FOLLOWER
I20260812 11:06:07.654742 23187 consensus_queue.cc:260] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.655066 23187 ts_tablet_manager.cc:1428] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:07.657289 23276 ts_tablet_manager.cc:1905] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:07.660892 23276 ts_tablet_manager.cc:1918] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:06:07.661084 23276 log.cc:1196] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/wal/wals/cb3ea87b04a94c229847e59a4c798618
I20260812 11:06:07.661448 23276 ts_tablet_manager.cc:1939] T cb3ea87b04a94c229847e59a4c798618 P 55c80a506afc4020b0f2ceee47204ff0: Deleting consensus metadata
I20260812 11:06:07.662974 22177 catalog_manager.cc:4841] TS 55c80a506afc4020b0f2ceee47204ff0 (127.18.174.193:45537): tablet cb3ea87b04a94c229847e59a4c798618 (table test-table [id=661ddbd18636498683ac33434d9c7701]) successfully deleted
I20260812 11:06:07.823215 23209 raft_consensus.cc:482] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:07.823385 23209 raft_consensus.cc:504] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.823860 23209 leader_election.cc:288] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55c80a506afc4020b0f2ceee47204ff0 (127.18.174.193:45537), ff17e46404ca467396c4957a9d8106ca (127.18.174.194:41297)
I20260812 11:06:07.824412 22764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47c9caffa66b4931b4a5ca1d3c654340" candidate_uuid: "e3785605fde741a68bcdee9e9659048e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff17e46404ca467396c4957a9d8106ca" is_pre_election: true
I20260812 11:06:07.824430 22504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47c9caffa66b4931b4a5ca1d3c654340" candidate_uuid: "e3785605fde741a68bcdee9e9659048e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c80a506afc4020b0f2ceee47204ff0" is_pre_election: true
I20260812 11:06:07.824581 22764 raft_consensus.cc:2454] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3785605fde741a68bcdee9e9659048e in term 0.
I20260812 11:06:07.824607 22504 raft_consensus.cc:2454] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3785605fde741a68bcdee9e9659048e in term 0.
I20260812 11:06:07.824905 22899 leader_election.cc:302] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3785605fde741a68bcdee9e9659048e, ff17e46404ca467396c4957a9d8106ca; no voters:
I20260812 11:06:07.825083 23209 raft_consensus.cc:2781] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:07.825150 23209 raft_consensus.cc:482] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:07.825189 23209 raft_consensus.cc:3037] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:07.826220 23209 raft_consensus.cc:504] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.826566 23209 leader_election.cc:288] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [CANDIDATE]: Term 1 election: Requested vote from peers 55c80a506afc4020b0f2ceee47204ff0 (127.18.174.193:45537), ff17e46404ca467396c4957a9d8106ca (127.18.174.194:41297)
I20260812 11:06:07.826918 22504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47c9caffa66b4931b4a5ca1d3c654340" candidate_uuid: "e3785605fde741a68bcdee9e9659048e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c80a506afc4020b0f2ceee47204ff0"
I20260812 11:06:07.826931 22764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47c9caffa66b4931b4a5ca1d3c654340" candidate_uuid: "e3785605fde741a68bcdee9e9659048e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff17e46404ca467396c4957a9d8106ca"
I20260812 11:06:07.827052 22764 raft_consensus.cc:3037] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:07.827049 22504 raft_consensus.cc:3037] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:07.827925 22764 raft_consensus.cc:2454] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3785605fde741a68bcdee9e9659048e in term 1.
I20260812 11:06:07.828007 22504 raft_consensus.cc:2454] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3785605fde741a68bcdee9e9659048e in term 1.
I20260812 11:06:07.828224 22899 leader_election.cc:302] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3785605fde741a68bcdee9e9659048e, ff17e46404ca467396c4957a9d8106ca; no voters:
I20260812 11:06:07.828400 23209 raft_consensus.cc:2781] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:07.828519 23209 raft_consensus.cc:686] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [term 1 LEADER]: Becoming Leader. State: Replica: e3785605fde741a68bcdee9e9659048e, State: Running, Role: LEADER
I20260812 11:06:07.828666 23209 consensus_queue.cc:237] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:07.830281 22200 catalog_manager.cc:5495] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e reported cstate change: term changed from 0 to 1, leader changed from <none> to e3785605fde741a68bcdee9e9659048e (127.18.174.195). New cstate: current_term: 1 leader_uuid: "e3785605fde741a68bcdee9e9659048e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260812 11:06:07.892869 22764 raft_consensus.cc:1261] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Refusing update from remote peer e3785605fde741a68bcdee9e9659048e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:07.893110 22504 raft_consensus.cc:1261] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Refusing update from remote peer e3785605fde741a68bcdee9e9659048e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:07.893270 23209 consensus_queue.cc:1035] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:07.893507 23265 consensus_queue.cc:1035] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [LEADER]: Connected to new peer: Peer: permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:06:07.905879 23241 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 11:06:09.458518 22200 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:09.458688 22200 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:09.461130 22200 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68: Sending DeleteTablet for 3 replicas of tablet 47c9caffa66b4931b4a5ca1d3c654340
I20260812 11:06:09.461824 22725 tablet_service.cc:1514] Processing DeleteTablet for tablet 47c9caffa66b4931b4a5ca1d3c654340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:09 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:40354
I20260812 11:06:09.461828 22465 tablet_service.cc:1514] Processing DeleteTablet for tablet 47c9caffa66b4931b4a5ca1d3c654340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:09 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:55312
I20260812 11:06:09.462215 23345 tablet_replica.cc:330] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca: stopping tablet replica
I20260812 11:06:09.462186 23000 tablet_service.cc:1514] Processing DeleteTablet for tablet 47c9caffa66b4931b4a5ca1d3c654340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:09 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:37568
I20260812 11:06:09.462353 23345 raft_consensus.cc:2229] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:09.462497 23345 raft_consensus.cc:2258] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:09.462570 23354 tablet_replica.cc:330] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e: stopping tablet replica
I20260812 11:06:09.462697 23354 raft_consensus.cc:2229] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:06:09.462901 23354 raft_consensus.cc:2258] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:09.463157 23345 ts_tablet_manager.cc:1905] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:09.463526 23354 ts_tablet_manager.cc:1905] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:09.465919 23345 ts_tablet_manager.cc:1918] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:06:09.466001 23345 log.cc:1196] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/47c9caffa66b4931b4a5ca1d3c654340
I20260812 11:06:09.466245 23345 ts_tablet_manager.cc:1939] T 47c9caffa66b4931b4a5ca1d3c654340 P ff17e46404ca467396c4957a9d8106ca: Deleting consensus metadata
I20260812 11:06:09.466405 23354 ts_tablet_manager.cc:1918] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:06:09.466491 23354 log.cc:1196] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/47c9caffa66b4931b4a5ca1d3c654340
I20260812 11:06:09.466758 23354 ts_tablet_manager.cc:1939] T 47c9caffa66b4931b4a5ca1d3c654340 P e3785605fde741a68bcdee9e9659048e: Deleting consensus metadata
I20260812 11:06:09.467067 22175 catalog_manager.cc:4841] TS ff17e46404ca467396c4957a9d8106ca (127.18.174.194:41297): tablet 47c9caffa66b4931b4a5ca1d3c654340 (table test-table [id=802c63c518c94571b7686107886d2a4b]) successfully deleted
I20260812 11:06:09.467568 22179 catalog_manager.cc:4841] TS e3785605fde741a68bcdee9e9659048e (127.18.174.195:43799): tablet 47c9caffa66b4931b4a5ca1d3c654340 (table test-table [id=802c63c518c94571b7686107886d2a4b]) successfully deleted
I20260812 11:06:09.468308 23353 tablet_replica.cc:330] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0: stopping tablet replica
I20260812 11:06:09.468457 23353 raft_consensus.cc:2229] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:09.468593 23353 raft_consensus.cc:2258] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:09.469213 23353 ts_tablet_manager.cc:1905] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:09.471453 23353 ts_tablet_manager.cc:1918] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:06:09.471534 23353 log.cc:1196] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/wal/wals/47c9caffa66b4931b4a5ca1d3c654340
I20260812 11:06:09.471753 23353 ts_tablet_manager.cc:1939] T 47c9caffa66b4931b4a5ca1d3c654340 P 55c80a506afc4020b0f2ceee47204ff0: Deleting consensus metadata
I20260812 11:06:09.472550 22177 catalog_manager.cc:4841] TS 55c80a506afc4020b0f2ceee47204ff0 (127.18.174.193:45537): tablet 47c9caffa66b4931b4a5ca1d3c654340 (table test-table [id=802c63c518c94571b7686107886d2a4b]) successfully deleted
Aug 12 11:06:09 dist-test-slave-lgr5 krb5kdc[22105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532769, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:06:09 dist-test-slave-lgr5 krb5kdc[22105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532769, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:09.489991 23364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:09.482022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60640 (local address 127.18.174.254:46841)
0812 11:06:09.482325 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:09.482331 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:09.482347 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:06:09.482474 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:09.482477 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:09.482527 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:09.482599 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:09.483243 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.483791 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.484666 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.484888 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.484967 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:09.487304 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:09.487308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:09.487310 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:09.487336 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:09.488624 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:09.489001 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:09.489004 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:09.489005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:09.489078 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:09.489263 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:09.489265 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:09.489266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:09.489436 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:09.489529 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:09.489701 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 11:06:09.489803 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":95,"threads_started":1}
I20260812 11:06:09.492650 22200 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60640:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:06:09.493074 22200 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:09.497993 22465 tablet_service.cc:1467] Processing CreateTablet for tablet eed7133fedf64be783d55858ff62a19d (DEFAULT_TABLE table=test-table [id=4619628d329a42a794f5bce8b3bd3f5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:09.498170 22725 tablet_service.cc:1467] Processing CreateTablet for tablet eed7133fedf64be783d55858ff62a19d (DEFAULT_TABLE table=test-table [id=4619628d329a42a794f5bce8b3bd3f5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:09.498417 22465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed7133fedf64be783d55858ff62a19d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:09.498479 22725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed7133fedf64be783d55858ff62a19d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:09.501029 23367 tablet_bootstrap.cc:492] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca: Bootstrap starting.
I20260812 11:06:09.501032 23000 tablet_service.cc:1467] Processing CreateTablet for tablet eed7133fedf64be783d55858ff62a19d (DEFAULT_TABLE table=test-table [id=4619628d329a42a794f5bce8b3bd3f5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:09.501344 23000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed7133fedf64be783d55858ff62a19d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:09.501484 23368 tablet_bootstrap.cc:492] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0: Bootstrap starting.
I20260812 11:06:09.502029 23367 tablet_bootstrap.cc:654] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:09.502342 23368 tablet_bootstrap.cc:654] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:09.503983 23367 tablet_bootstrap.cc:492] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca: No bootstrap required, opened a new log
I20260812 11:06:09.504107 23367 ts_tablet_manager.cc:1397] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:09.504346 23368 tablet_bootstrap.cc:492] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0: No bootstrap required, opened a new log
I20260812 11:06:09.504439 23368 ts_tablet_manager.cc:1397] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:09.504616 23367 raft_consensus.cc:348] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.504719 23367 raft_consensus.cc:374] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:09.504739 23367 raft_consensus.cc:729] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff17e46404ca467396c4957a9d8106ca, State: Initialized, Role: FOLLOWER
I20260812 11:06:09.504865 23367 consensus_queue.cc:260] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.504860 23368 raft_consensus.cc:348] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.504973 23368 raft_consensus.cc:374] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:09.505014 23368 raft_consensus.cc:729] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55c80a506afc4020b0f2ceee47204ff0, State: Initialized, Role: FOLLOWER
I20260812 11:06:09.505139 23368 consensus_queue.cc:260] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.505236 23367 ts_tablet_manager.cc:1428] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:09.505399 23368 ts_tablet_manager.cc:1428] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 11:06:09.505491 23374 tablet_bootstrap.cc:492] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e: Bootstrap starting.
I20260812 11:06:09.506407 23374 tablet_bootstrap.cc:654] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:09.507649 23374 tablet_bootstrap.cc:492] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e: No bootstrap required, opened a new log
I20260812 11:06:09.507745 23374 ts_tablet_manager.cc:1397] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:06:09.508226 23374 raft_consensus.cc:348] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.508363 23374 raft_consensus.cc:374] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:09.508409 23374 raft_consensus.cc:729] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3785605fde741a68bcdee9e9659048e, State: Initialized, Role: FOLLOWER
I20260812 11:06:09.508536 23374 consensus_queue.cc:260] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.508806 23374 ts_tablet_manager.cc:1428] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:09.526505 23299 raft_consensus.cc:482] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:09.526679 23299 raft_consensus.cc:504] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.527143 23299 leader_election.cc:288] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff17e46404ca467396c4957a9d8106ca (127.18.174.194:41297), e3785605fde741a68bcdee9e9659048e (127.18.174.195:43799)
I20260812 11:06:09.527663 22763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed7133fedf64be783d55858ff62a19d" candidate_uuid: "55c80a506afc4020b0f2ceee47204ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff17e46404ca467396c4957a9d8106ca" is_pre_election: true
I20260812 11:06:09.527661 23044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed7133fedf64be783d55858ff62a19d" candidate_uuid: "55c80a506afc4020b0f2ceee47204ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3785605fde741a68bcdee9e9659048e" is_pre_election: true
I20260812 11:06:09.527837 23044 raft_consensus.cc:2454] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55c80a506afc4020b0f2ceee47204ff0 in term 0.
I20260812 11:06:09.527837 22763 raft_consensus.cc:2454] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55c80a506afc4020b0f2ceee47204ff0 in term 0.
I20260812 11:06:09.528208 22374 leader_election.cc:302] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 55c80a506afc4020b0f2ceee47204ff0, e3785605fde741a68bcdee9e9659048e, ff17e46404ca467396c4957a9d8106ca; no voters:
I20260812 11:06:09.528416 23299 raft_consensus.cc:2781] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:09.528505 23299 raft_consensus.cc:482] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:09.528545 23299 raft_consensus.cc:3037] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:09.529892 23299 raft_consensus.cc:504] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.530246 23299 leader_election.cc:288] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [CANDIDATE]: Term 1 election: Requested vote from peers ff17e46404ca467396c4957a9d8106ca (127.18.174.194:41297), e3785605fde741a68bcdee9e9659048e (127.18.174.195:43799)
I20260812 11:06:09.530668 22763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed7133fedf64be783d55858ff62a19d" candidate_uuid: "55c80a506afc4020b0f2ceee47204ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff17e46404ca467396c4957a9d8106ca"
I20260812 11:06:09.530651 23044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed7133fedf64be783d55858ff62a19d" candidate_uuid: "55c80a506afc4020b0f2ceee47204ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3785605fde741a68bcdee9e9659048e"
I20260812 11:06:09.530797 22763 raft_consensus.cc:3037] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:09.530798 23044 raft_consensus.cc:3037] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:09.532011 22763 raft_consensus.cc:2454] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55c80a506afc4020b0f2ceee47204ff0 in term 1.
I20260812 11:06:09.532013 23044 raft_consensus.cc:2454] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55c80a506afc4020b0f2ceee47204ff0 in term 1.
I20260812 11:06:09.532373 22369 leader_election.cc:302] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 55c80a506afc4020b0f2ceee47204ff0, e3785605fde741a68bcdee9e9659048e, ff17e46404ca467396c4957a9d8106ca; no voters:
I20260812 11:06:09.532547 23299 raft_consensus.cc:2781] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:09.532637 23299 raft_consensus.cc:686] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [term 1 LEADER]: Becoming Leader. State: Replica: 55c80a506afc4020b0f2ceee47204ff0, State: Running, Role: LEADER
I20260812 11:06:09.532786 23299 consensus_queue.cc:237] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.534590 22204 catalog_manager.cc:5495] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55c80a506afc4020b0f2ceee47204ff0 (127.18.174.193). New cstate: current_term: 1 leader_uuid: "55c80a506afc4020b0f2ceee47204ff0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260812 11:06:09.550109 23388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:09.547232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55324 (local address 127.18.174.193:45537)
0812 11:06:09.547486 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:09.547494 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:09.547505 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:06:09.547543 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:09.547545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:09.547588 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:09.547653 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:09.547857 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.548443 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.549223 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.549430 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.549498 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:09.549681 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:09.549748 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:09.549793 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:09.549899 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 11:06:09.549955 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":108,"threads_started":1}
I20260812 11:06:09.558881 23388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:09.556216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:52215 (local address 127.18.174.193:45537)
0812 11:06:09.556334 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:09.556338 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:09.556468 (+ 130us) server_negotiation.cc:407] Connection header received
0812 11:06:09.556560 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:09.556563 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:09.556614 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:09.556695 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:09.556910 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.557386 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.558131 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.558326 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.558390 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:09.558555 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:09.558615 (+ 60us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:09.558659 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:09.558718 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 11:06:09.558759 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:06:09.558900 23393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:09.556181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:45537 (local address 127.18.174.193:52215)
0812 11:06:09.556398 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:09.556409 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:09.556498 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:09.556706 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:09.556709 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:09.556717 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:06:09.556810 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:09.556814 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.557457 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.557459 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:09.558051 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:09.558058 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.558396 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.558399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:09.558453 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:09.558479 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:06:09.558665 (+ 186us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:06:09.558669 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:06:09.558705 (+ 36us) client_negotiation.cc:240] Negotiation successful
0812 11:06:09.558763 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":3,"thread_start_us":97,"threads_started":1}
I20260812 11:06:09.564523 22763 raft_consensus.cc:1261] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Refusing update from remote peer 55c80a506afc4020b0f2ceee47204ff0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:09.564612 23044 raft_consensus.cc:1261] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Refusing update from remote peer 55c80a506afc4020b0f2ceee47204ff0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:09.564961 23201 consensus_queue.cc:1035] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:09.565116 23299 consensus_queue.cc:1035] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:09.598269 22203 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:09.598450 22203 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:09.600690 22203 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68: Sending DeleteTablet for 3 replicas of tablet eed7133fedf64be783d55858ff62a19d
I20260812 11:06:09.601272 22466 tablet_service.cc:1514] Processing DeleteTablet for tablet eed7133fedf64be783d55858ff62a19d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:09 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:55312
I20260812 11:06:09.601398 22725 tablet_service.cc:1514] Processing DeleteTablet for tablet eed7133fedf64be783d55858ff62a19d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:09 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:40354
I20260812 11:06:09.601523 23353 tablet_replica.cc:330] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0: stopping tablet replica
I20260812 11:06:09.601632 23345 tablet_replica.cc:330] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca: stopping tablet replica
I20260812 11:06:09.601650 23353 raft_consensus.cc:2229] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:06:09.601640 23000 tablet_service.cc:1514] Processing DeleteTablet for tablet eed7133fedf64be783d55858ff62a19d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:09 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:37568
I20260812 11:06:09.601758 23345 raft_consensus.cc:2229] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:09.601816 23354 tablet_replica.cc:330] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e: stopping tablet replica
I20260812 11:06:09.601877 23345 raft_consensus.cc:2258] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:09.601920 23354 raft_consensus.cc:2229] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:09.601972 23353 raft_consensus.cc:2258] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:09.602041 23354 raft_consensus.cc:2258] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:09.602711 23345 ts_tablet_manager.cc:1905] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:09.602811 23353 ts_tablet_manager.cc:1905] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:09.603965 23354 ts_tablet_manager.cc:1905] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:09.605448 23353 ts_tablet_manager.cc:1918] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:06:09.605502 23345 ts_tablet_manager.cc:1918] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:06:09.605535 23353 log.cc:1196] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-0/wal/wals/eed7133fedf64be783d55858ff62a19d
I20260812 11:06:09.605574 23345 log.cc:1196] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/eed7133fedf64be783d55858ff62a19d
I20260812 11:06:09.605786 23353 ts_tablet_manager.cc:1939] T eed7133fedf64be783d55858ff62a19d P 55c80a506afc4020b0f2ceee47204ff0: Deleting consensus metadata
I20260812 11:06:09.605816 23345 ts_tablet_manager.cc:1939] T eed7133fedf64be783d55858ff62a19d P ff17e46404ca467396c4957a9d8106ca: Deleting consensus metadata
I20260812 11:06:09.606184 22203 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60640:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 11:06:09.606575 23354 ts_tablet_manager.cc:1918] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:06:09.606643 23354 log.cc:1196] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/eed7133fedf64be783d55858ff62a19d
W20260812 11:06:09.606680 22203 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:09.606873 23354 ts_tablet_manager.cc:1939] T eed7133fedf64be783d55858ff62a19d P e3785605fde741a68bcdee9e9659048e: Deleting consensus metadata
I20260812 11:06:09.607177 22177 catalog_manager.cc:4841] TS 55c80a506afc4020b0f2ceee47204ff0 (127.18.174.193:45537): tablet eed7133fedf64be783d55858ff62a19d (table test-table [id=4619628d329a42a794f5bce8b3bd3f5e]) successfully deleted
I20260812 11:06:09.607628 22175 catalog_manager.cc:4841] TS ff17e46404ca467396c4957a9d8106ca (127.18.174.194:41297): tablet eed7133fedf64be783d55858ff62a19d (table test-table [id=4619628d329a42a794f5bce8b3bd3f5e]) successfully deleted
I20260812 11:06:09.608163 22179 catalog_manager.cc:4841] TS e3785605fde741a68bcdee9e9659048e (127.18.174.195:43799): tablet eed7133fedf64be783d55858ff62a19d (table test-table [id=4619628d329a42a794f5bce8b3bd3f5e]) successfully deleted
I20260812 11:06:09.611930 22466 tablet_service.cc:1467] Processing CreateTablet for tablet ae671225f921419fb5b1cd6fde1b55ee (DEFAULT_TABLE table=test-table [id=5a7bdc9d128b468a8d2b06e507f6786a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:09.612313 22725 tablet_service.cc:1467] Processing CreateTablet for tablet ae671225f921419fb5b1cd6fde1b55ee (DEFAULT_TABLE table=test-table [id=5a7bdc9d128b468a8d2b06e507f6786a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:09.612387 22466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae671225f921419fb5b1cd6fde1b55ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:09.612619 22725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae671225f921419fb5b1cd6fde1b55ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:09.614609 23367 tablet_bootstrap.cc:492] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca: Bootstrap starting.
I20260812 11:06:09.614813 23000 tablet_service.cc:1467] Processing CreateTablet for tablet ae671225f921419fb5b1cd6fde1b55ee (DEFAULT_TABLE table=test-table [id=5a7bdc9d128b468a8d2b06e507f6786a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:09.615119 23000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae671225f921419fb5b1cd6fde1b55ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:09.615669 23367 tablet_bootstrap.cc:654] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:09.617406 23374 tablet_bootstrap.cc:492] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e: Bootstrap starting.
I20260812 11:06:09.617501 23368 tablet_bootstrap.cc:492] T ae671225f921419fb5b1cd6fde1b55ee P 55c80a506afc4020b0f2ceee47204ff0: Bootstrap starting.
I20260812 11:06:09.618288 23368 tablet_bootstrap.cc:654] T ae671225f921419fb5b1cd6fde1b55ee P 55c80a506afc4020b0f2ceee47204ff0: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:09.618288 23374 tablet_bootstrap.cc:654] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:09.619452 23368 tablet_bootstrap.cc:492] T ae671225f921419fb5b1cd6fde1b55ee P 55c80a506afc4020b0f2ceee47204ff0: No bootstrap required, opened a new log
I20260812 11:06:09.619554 23368 ts_tablet_manager.cc:1397] T ae671225f921419fb5b1cd6fde1b55ee P 55c80a506afc4020b0f2ceee47204ff0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:06:09.619967 23368 raft_consensus.cc:348] T ae671225f921419fb5b1cd6fde1b55ee P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.620121 23368 raft_consensus.cc:374] T ae671225f921419fb5b1cd6fde1b55ee P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:09.620131 23367 tablet_bootstrap.cc:492] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca: No bootstrap required, opened a new log
I20260812 11:06:09.620155 23368 raft_consensus.cc:729] T ae671225f921419fb5b1cd6fde1b55ee P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55c80a506afc4020b0f2ceee47204ff0, State: Initialized, Role: FOLLOWER
I20260812 11:06:09.620219 23367 ts_tablet_manager.cc:1397] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260812 11:06:09.620288 23368 consensus_queue.cc:260] T ae671225f921419fb5b1cd6fde1b55ee P 55c80a506afc4020b0f2ceee47204ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.620568 23368 ts_tablet_manager.cc:1428] T ae671225f921419fb5b1cd6fde1b55ee P 55c80a506afc4020b0f2ceee47204ff0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:09.620667 23367 raft_consensus.cc:348] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.620796 23367 raft_consensus.cc:374] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:09.620839 23367 raft_consensus.cc:729] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff17e46404ca467396c4957a9d8106ca, State: Initialized, Role: FOLLOWER
I20260812 11:06:09.621002 23367 consensus_queue.cc:260] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.621287 23367 ts_tablet_manager.cc:1428] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:09.622143 23374 tablet_bootstrap.cc:492] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e: No bootstrap required, opened a new log
I20260812 11:06:09.622255 23374 ts_tablet_manager.cc:1397] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260812 11:06:09.622718 23374 raft_consensus.cc:348] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.622846 23374 raft_consensus.cc:374] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:09.622889 23374 raft_consensus.cc:729] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3785605fde741a68bcdee9e9659048e, State: Initialized, Role: FOLLOWER
I20260812 11:06:09.623023 23374 consensus_queue.cc:260] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.623288 23374 ts_tablet_manager.cc:1428] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:09.864225 23375 raft_consensus.cc:482] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:09.864403 23375 raft_consensus.cc:504] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.865564 23375 leader_election.cc:288] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55c80a506afc4020b0f2ceee47204ff0 (127.18.174.193:45537), e3785605fde741a68bcdee9e9659048e (127.18.174.195:43799)
I20260812 11:06:09.869746 23388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:09.865954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:54087 (local address 127.18.174.193:45537)
0812 11:06:09.866104 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:09.866109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:09.866443 (+ 334us) server_negotiation.cc:407] Connection header received
0812 11:06:09.866577 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:09.866580 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:09.866623 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:09.866685 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:09.866961 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.867579 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.868741 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.869191 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.869306 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:09.869360 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:09.869540 (+ 180us) server_negotiation.cc:299] Negotiation successful
0812 11:06:09.869619 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 11:06:09.869771 23413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:09.865850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:45537 (local address 127.18.174.194:54087)
0812 11:06:09.866339 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:09.866352 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:09.866461 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:09.866708 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:09.866711 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:09.866727 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:09.866861 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:09.866866 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.867713 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.867717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:09.868625 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:09.868635 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.869303 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.869307 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:09.869426 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:09.869444 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 11:06:09.869513 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 11:06:09.869601 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"mutex_wait_us":59,"thread_start_us":113,"threads_started":1}
I20260812 11:06:09.869766 23415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:09.865965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:40955 (local address 127.18.174.195:43799)
0812 11:06:09.866280 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:09.866295 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:09.866345 (+ 50us) server_negotiation.cc:407] Connection header received
0812 11:06:09.866522 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:09.866524 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:09.866568 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:09.866644 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:09.866929 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.867472 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.868748 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.869161 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.869275 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:09.869336 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:09.869554 (+ 218us) server_negotiation.cc:299] Negotiation successful
0812 11:06:09.869632 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":87,"threads_started":1}
I20260812 11:06:09.869777 23414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:09.865850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:43799 (local address 127.18.174.194:40955)
0812 11:06:09.866257 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:09.866273 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:09.866410 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:09.866662 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:09.866665 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:09.866681 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:09.866826 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:09.866832 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.867590 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.867594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:09.868623 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:09.868633 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.869275 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.869279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:09.869375 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:09.869441 (+ 66us) client_negotiation.cc:769] Sending connection context
0812 11:06:09.869508 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:06:09.869612 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":57,"thread_start_us":129,"threads_started":1}
I20260812 11:06:09.870249 22504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae671225f921419fb5b1cd6fde1b55ee" candidate_uuid: "ff17e46404ca467396c4957a9d8106ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c80a506afc4020b0f2ceee47204ff0" is_pre_election: true
I20260812 11:06:09.870407 22504 raft_consensus.cc:2454] T ae671225f921419fb5b1cd6fde1b55ee P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff17e46404ca467396c4957a9d8106ca in term 0.
I20260812 11:06:09.870699 23044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae671225f921419fb5b1cd6fde1b55ee" candidate_uuid: "ff17e46404ca467396c4957a9d8106ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3785605fde741a68bcdee9e9659048e" is_pre_election: true
I20260812 11:06:09.870828 23044 raft_consensus.cc:2454] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff17e46404ca467396c4957a9d8106ca in term 0.
I20260812 11:06:09.870824 22646 leader_election.cc:302] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55c80a506afc4020b0f2ceee47204ff0, ff17e46404ca467396c4957a9d8106ca; no voters:
I20260812 11:06:09.871134 23375 raft_consensus.cc:2781] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:09.871191 23375 raft_consensus.cc:482] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:09.871217 23375 raft_consensus.cc:3037] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:09.872280 23375 raft_consensus.cc:504] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.872641 23375 leader_election.cc:288] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [CANDIDATE]: Term 1 election: Requested vote from peers 55c80a506afc4020b0f2ceee47204ff0 (127.18.174.193:45537), e3785605fde741a68bcdee9e9659048e (127.18.174.195:43799)
I20260812 11:06:09.872983 23044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae671225f921419fb5b1cd6fde1b55ee" candidate_uuid: "ff17e46404ca467396c4957a9d8106ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3785605fde741a68bcdee9e9659048e"
I20260812 11:06:09.873109 23044 raft_consensus.cc:3037] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:09.873126 22504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae671225f921419fb5b1cd6fde1b55ee" candidate_uuid: "ff17e46404ca467396c4957a9d8106ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c80a506afc4020b0f2ceee47204ff0"
I20260812 11:06:09.873258 22504 raft_consensus.cc:3037] T ae671225f921419fb5b1cd6fde1b55ee P 55c80a506afc4020b0f2ceee47204ff0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:09.874092 23044 raft_consensus.cc:2454] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff17e46404ca467396c4957a9d8106ca in term 1.
I20260812 11:06:09.874212 22504 raft_consensus.cc:2454] T ae671225f921419fb5b1cd6fde1b55ee P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff17e46404ca467396c4957a9d8106ca in term 1.
I20260812 11:06:09.874953 22647 leader_election.cc:302] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3785605fde741a68bcdee9e9659048e, ff17e46404ca467396c4957a9d8106ca; no voters:
I20260812 11:06:09.875164 23375 raft_consensus.cc:2781] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:09.875363 23375 raft_consensus.cc:686] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [term 1 LEADER]: Becoming Leader. State: Replica: ff17e46404ca467396c4957a9d8106ca, State: Running, Role: LEADER
I20260812 11:06:09.875672 23375 consensus_queue.cc:237] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } }
I20260812 11:06:09.878257 22203 catalog_manager.cc:5495] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca reported cstate change: term changed from 0 to 1, leader changed from <none> to ff17e46404ca467396c4957a9d8106ca (127.18.174.194). New cstate: current_term: 1 leader_uuid: "ff17e46404ca467396c4957a9d8106ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff17e46404ca467396c4957a9d8106ca" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260812 11:06:09.925815 23422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:09.922400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53014 (local address 127.18.174.194:41297)
0812 11:06:09.922749 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:09.922756 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:09.922768 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:06:09.922844 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:09.922846 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:09.922898 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:09.923014 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:09.923192 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.923718 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.924478 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.924708 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.924777 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:09.924966 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:09.925451 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:09.925538 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:09.925581 (+ 43us) server_negotiation.cc:299] Negotiation successful
0812 11:06:09.925632 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":188,"threads_started":1}
I20260812 11:06:09.936225 23388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:09.933344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:47887 (local address 127.18.174.193:45537)
0812 11:06:09.933484 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:09.933489 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:09.933522 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:06:09.933651 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:09.933654 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:09.933705 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:09.933767 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:09.933971 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.934474 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.935284 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.935493 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.935562 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:09.935803 (+ 241us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:09.935876 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:09.935923 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:09.936002 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 11:06:09.936055 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:06:09.936262 23430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:09.933130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:45537 (local address 127.18.174.194:47887)
0812 11:06:09.933453 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:09.933467 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:09.933570 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:09.933779 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:09.933781 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:09.933786 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:06:09.933893 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:09.933898 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.934556 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.934559 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:09.935192 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:09.935201 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.935575 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.935577 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:09.935644 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:09.935696 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:06:09.935931 (+ 235us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:06:09.935936 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 11:06:09.935991 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 11:06:09.936058 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":91,"threads_started":1}
I20260812 11:06:09.942948 22504 raft_consensus.cc:1261] T ae671225f921419fb5b1cd6fde1b55ee P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Refusing update from remote peer ff17e46404ca467396c4957a9d8106ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:09.943040 23044 raft_consensus.cc:1261] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Refusing update from remote peer ff17e46404ca467396c4957a9d8106ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:09.943490 23416 consensus_queue.cc:1035] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "55c80a506afc4020b0f2ceee47204ff0" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:09.943671 23375 consensus_queue.cc:1035] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3785605fde741a68bcdee9e9659048e" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:09.961395 23422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:09.958382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:58161 (local address 127.18.174.194:41297)
0812 11:06:09.958503 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:09.958508 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:09.958524 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:06:09.958649 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:09.958652 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:09.958693 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:09.958750 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:09.959000 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.959508 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.960384 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.960611 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.960699 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:09.960948 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:09.961029 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:09.961086 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:09.961189 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 11:06:09.961252 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 11:06:09.961419 23393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:09.958325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:41297 (local address 127.18.174.193:58161)
0812 11:06:09.958458 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:09.958475 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:09.958556 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:09.958783 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:09.958786 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:09.958795 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:06:09.958898 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:09.958904 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.959617 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.959621 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:09.960273 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:09.960283 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:09.960710 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:09.960713 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:09.960801 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:09.960834 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:06:09.961105 (+ 271us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:06:09.961111 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:06:09.961183 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 11:06:09.961283 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 11:06:09.962174 23301 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 11:06:11.524469 22203 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:11.524639 22203 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:11.527115 22203 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 49a80ce7937c41268bb7c9339fedca68: Sending DeleteTablet for 3 replicas of tablet ae671225f921419fb5b1cd6fde1b55ee
I20260812 11:06:11.527724 22466 tablet_service.cc:1514] Processing DeleteTablet for tablet ae671225f921419fb5b1cd6fde1b55ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:11 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:55312
I20260812 11:06:11.527781 22725 tablet_service.cc:1514] Processing DeleteTablet for tablet ae671225f921419fb5b1cd6fde1b55ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:11 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:40354
I20260812 11:06:11.528167 23493 tablet_replica.cc:330] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca: stopping tablet replica
I20260812 11:06:11.528149 23000 tablet_service.cc:1514] Processing DeleteTablet for tablet ae671225f921419fb5b1cd6fde1b55ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:11 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:37568
I20260812 11:06:11.528244 23486 tablet_replica.cc:330] T ae671225f921419fb5b1cd6fde1b55ee P 55c80a506afc4020b0f2ceee47204ff0: stopping tablet replica
I20260812 11:06:11.528324 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 22334
I20260812 11:06:11.528370 23486 raft_consensus.cc:2229] T ae671225f921419fb5b1cd6fde1b55ee P 55c80a506afc4020b0f2ceee47204ff0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:11.533747 23494 tablet_replica.cc:330] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e: stopping tablet replica
I20260812 11:06:11.533779 23493 raft_consensus.cc:2229] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:06:11.533923 23494 raft_consensus.cc:2229] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:11.534101 23494 raft_consensus.cc:2258] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:11.534235 23493 raft_consensus.cc:2258] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:11.536748 23493 ts_tablet_manager.cc:1905] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:11.539186 23493 ts_tablet_manager.cc:1918] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:06:11.539266 23493 log.cc:1196] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/ae671225f921419fb5b1cd6fde1b55ee
I20260812 11:06:11.539529 23493 ts_tablet_manager.cc:1939] T ae671225f921419fb5b1cd6fde1b55ee P ff17e46404ca467396c4957a9d8106ca: Deleting consensus metadata
I20260812 11:06:11.540345 22175 catalog_manager.cc:4841] TS ff17e46404ca467396c4957a9d8106ca (127.18.174.194:41297): tablet ae671225f921419fb5b1cd6fde1b55ee (table test-table [id=5a7bdc9d128b468a8d2b06e507f6786a]) successfully deleted
I20260812 11:06:11.541337 23494 ts_tablet_manager.cc:1905] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:11.543534 23494 ts_tablet_manager.cc:1918] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:06:11.543610 23494 log.cc:1196] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/ae671225f921419fb5b1cd6fde1b55ee
I20260812 11:06:11.543828 23494 ts_tablet_manager.cc:1939] T ae671225f921419fb5b1cd6fde1b55ee P e3785605fde741a68bcdee9e9659048e: Deleting consensus metadata
I20260812 11:06:11.544637 22179 catalog_manager.cc:4841] TS e3785605fde741a68bcdee9e9659048e (127.18.174.195:43799): tablet ae671225f921419fb5b1cd6fde1b55ee (table test-table [id=5a7bdc9d128b468a8d2b06e507f6786a]) successfully deleted
W20260812 11:06:11.548617 22177 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:45537 (error 108)
I20260812 11:06:11.548774 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 22612
I20260812 11:06:11.568342 23503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:11.560771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:45537 (local address 127.0.0.1:45842)
0812 11:06:11.568011 (+ 7240us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:11.568217 (+ 206us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:45537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7118,"thread_start_us":1332,"threads_started":1}
W20260812 11:06:11.568503 22177 catalog_manager.cc:4584] TS 55c80a506afc4020b0f2ceee47204ff0 (127.18.174.193:45537): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ae671225f921419fb5b1cd6fde1b55ee: Network error: Client connection negotiation failed: client connection to 127.18.174.193:45537: connect: Connection refused (error 111)
I20260812 11:06:11.586905 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 22877
I20260812 11:06:11.606336 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 22135
2026-08-12T11:06:11Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6833 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:06:11 dist-test-slave-lgr5 krb5kdc[23507](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:06:11 dist-test-slave-lgr5 krb5kdc[23507](info): set up 2 sockets
Aug 12 11:06:11 dist-test-slave-lgr5 krb5kdc[23507](info): commencing operation
krb5kdc: starting...
W20260812 11:06:12.822233 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:06:12 dist-test-slave-lgr5 krb5kdc[23507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:06:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:06:12.950706 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:38119
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:39483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:38119
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:13.065701 23536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:13.065996 23536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:13.066036 23536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:13.070019 23536 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:13.070080 23536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:13.070097 23536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:13.070113 23536 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:13.070147 23536 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:13.075515 23536 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:38119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:38119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:13.076638 23536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:13.077639 23536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:13.086089 23547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:13.086109 23551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:13.086192 23536 server_base.cc:1034] running on GCE node
W20260812 11:06:13.086102 23549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:13.086964 23536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:13.088156 23536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:13.089324 23536 hybrid_clock.cc:648] HybridClock initialized: now 1786532773089307 us; error 32 us; skew 500 ppm
Aug 12 11:06:13 dist-test-slave-lgr5 krb5kdc[23507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532773, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:13.092052 23536 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:06:13.092991 23536 webserver.cc:460] Webserver started at http://127.18.174.254:39389/ using document root <none> and password file <none>
I20260812 11:06:13.093545 23536 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:13.093614 23536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:13.093817 23536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:13.095911 23536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "ede277630ac543879a54a57ad6f2b6b1"
format_stamp: "Formatted at 2026-08-12 11:06:13 on dist-test-slave-lgr5"
server_key: "d7830424233a46aede78efdbf106b735"
server_key_iv: "0d11fd40f49f775be027ddeb5b6402f4"
server_key_version: "encryptionkey@0"
I20260812 11:06:13.096524 23536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "ede277630ac543879a54a57ad6f2b6b1"
format_stamp: "Formatted at 2026-08-12 11:06:13 on dist-test-slave-lgr5"
server_key: "d7830424233a46aede78efdbf106b735"
server_key_iv: "0d11fd40f49f775be027ddeb5b6402f4"
server_key_version: "encryptionkey@0"
I20260812 11:06:13.100391 23536 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:06:13.102903 23559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:13.104190 23536 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:13.104311 23536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "ede277630ac543879a54a57ad6f2b6b1"
format_stamp: "Formatted at 2026-08-12 11:06:13 on dist-test-slave-lgr5"
server_key: "d7830424233a46aede78efdbf106b735"
server_key_iv: "0d11fd40f49f775be027ddeb5b6402f4"
server_key_version: "encryptionkey@0"
I20260812 11:06:13.104413 23536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:13.118691 23536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:13.121851 23536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:13.122051 23536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:13.129061 23536 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:38119
I20260812 11:06:13.129074 23650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:38119 every 8 connection(s)
I20260812 11:06:13.130081 23536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:13.133054 23654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:13.138049 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 23536
I20260812 11:06:13.138154 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:13.138402 19131 external_mini_cluster.cc:1428] Setting key fda92e0e09106c84f452c5f1db2c9d1f
I20260812 11:06:13.139091 23654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1: Bootstrap starting.
I20260812 11:06:13.141929 23654 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:13.142851 23654 log.cc:824] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:13.145278 23654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1: No bootstrap required, opened a new log
Aug 12 11:06:13 dist-test-slave-lgr5 krb5kdc[23507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:13.149366 23654 raft_consensus.cc:348] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede277630ac543879a54a57ad6f2b6b1" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38119 } }
I20260812 11:06:13.149616 23654 raft_consensus.cc:374] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:13.149667 23654 raft_consensus.cc:729] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede277630ac543879a54a57ad6f2b6b1, State: Initialized, Role: FOLLOWER
I20260812 11:06:13.150141 23654 consensus_queue.cc:260] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede277630ac543879a54a57ad6f2b6b1" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38119 } }
I20260812 11:06:13.150272 23654 raft_consensus.cc:388] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:13.150332 23654 raft_consensus.cc:482] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:13.150431 23654 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:13.151494 23654 raft_consensus.cc:504] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede277630ac543879a54a57ad6f2b6b1" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38119 } }
I20260812 11:06:13.151892 23654 leader_election.cc:302] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ede277630ac543879a54a57ad6f2b6b1; no voters:
I20260812 11:06:13.152284 23654 leader_election.cc:288] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:13.152370 23660 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:13.152585 23660 raft_consensus.cc:686] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [term 1 LEADER]: Becoming Leader. State: Replica: ede277630ac543879a54a57ad6f2b6b1, State: Running, Role: LEADER
I20260812 11:06:13.152908 23660 consensus_queue.cc:237] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede277630ac543879a54a57ad6f2b6b1" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38119 } }
I20260812 11:06:13.153743 23654 sys_catalog.cc:564] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:13.154105 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:13.139955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48144 (local address 127.18.174.254:38119)
0812 11:06:13.140457 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:13.140477 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:13.140547 (+ 70us) server_negotiation.cc:407] Connection header received
0812 11:06:13.141400 (+ 853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:13.141425 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:13.141870 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:13.142285 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:13.142957 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:13.144286 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:13.145460 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:13.146075 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:13.146246 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:13.148985 (+ 2739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:13.148991 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:13.149006 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:13.149036 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:13.150834 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:13.151344 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:13.151349 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:13.151355 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:13.151480 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:13.151827 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:13.151829 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:13.151831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:13.152378 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:13.152581 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:13.152890 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 11:06:13.153240 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":170,"threads_started":1}
I20260812 11:06:13.154258 23660 sys_catalog.cc:455] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ede277630ac543879a54a57ad6f2b6b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede277630ac543879a54a57ad6f2b6b1" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38119 } } }
I20260812 11:06:13.154443 23664 sys_catalog.cc:455] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ede277630ac543879a54a57ad6f2b6b1. Latest consensus state: current_term: 1 leader_uuid: "ede277630ac543879a54a57ad6f2b6b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede277630ac543879a54a57ad6f2b6b1" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38119 } } }
I20260812 11:06:13.154493 23660 sys_catalog.cc:458] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:13.156399 23664 sys_catalog.cc:458] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1 [sys.catalog]: This master's current role is: LEADER
W20260812 11:06:13.159897 23698 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:06:13.159981 23698 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:06:13.160072 23695 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:13.160840 23695 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:13.166280 23695 catalog_manager.cc:1347] Generated new cluster ID: e18609fc00fe45baa17987cf67fd8ede
I20260812 11:06:13.166355 23695 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:13.181437 23695 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:13.182441 23695 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:13.195485 23695 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ede277630ac543879a54a57ad6f2b6b1: Generated new TSK 0
I20260812 11:06:13.196343 23695 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:06:13.231390 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:38119
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:39483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:13.378270 23709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:13.378785 23709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:13.378856 23709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:13.383047 23709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:13.383109 23709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:13.383169 23709 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:13.388448 23709 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:38119
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23709
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:13.389660 23709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:13.390815 23709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:13.401360 23724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:13.401394 23721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:13.401455 23722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:13.401628 23709 server_base.cc:1034] running on GCE node
I20260812 11:06:13.402074 23709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:13.402796 23709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:13.403961 23709 hybrid_clock.cc:648] HybridClock initialized: now 1786532773403936 us; error 41 us; skew 500 ppm
Aug 12 11:06:13 dist-test-slave-lgr5 krb5kdc[23507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532773, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:13.406807 23709 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:06:13.407857 23709 webserver.cc:460] Webserver started at http://127.18.174.193:35029/ using document root <none> and password file <none>
I20260812 11:06:13.408500 23709 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:13.408576 23709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:13.408816 23709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:13.410964 23709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "bf274b8509504cc3bbe1c3f2841708d8"
format_stamp: "Formatted at 2026-08-12 11:06:13 on dist-test-slave-lgr5"
server_key: "ab753eafb582978aa0e699856eaef49c"
server_key_iv: "d59776525e1bb977f0973bf1f275448f"
server_key_version: "encryptionkey@0"
I20260812 11:06:13.411618 23709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "bf274b8509504cc3bbe1c3f2841708d8"
format_stamp: "Formatted at 2026-08-12 11:06:13 on dist-test-slave-lgr5"
server_key: "ab753eafb582978aa0e699856eaef49c"
server_key_iv: "d59776525e1bb977f0973bf1f275448f"
server_key_version: "encryptionkey@0"
I20260812 11:06:13.415606 23709 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:06:13.418217 23735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:13.419518 23709 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:06:13.419649 23709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "bf274b8509504cc3bbe1c3f2841708d8"
format_stamp: "Formatted at 2026-08-12 11:06:13 on dist-test-slave-lgr5"
server_key: "ab753eafb582978aa0e699856eaef49c"
server_key_iv: "d59776525e1bb977f0973bf1f275448f"
server_key_version: "encryptionkey@0"
I20260812 11:06:13.419755 23709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:13.438210 23709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:13.441424 23709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:13.441649 23709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:13.442282 23709 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:13.443174 23709 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:13.443225 23709 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:13.443281 23709 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:13.443307 23709 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:13.452047 23709 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:37907
I20260812 11:06:13.452121 23965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:37907 every 8 connection(s)
I20260812 11:06:13.453059 23709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:06:13.459235 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 23709
I20260812 11:06:13.459357 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:06:13.459667 19131 external_mini_cluster.cc:1428] Setting key 815f14859fa8bda08accb3af4484deb6
Aug 12 11:06:13 dist-test-slave-lgr5 krb5kdc[23507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532773, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:13.467407 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:13.455078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:42961 (local address 127.18.174.254:38119)
0812 11:06:13.455223 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:13.455227 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:13.456423 (+ 1196us) server_negotiation.cc:407] Connection header received
0812 11:06:13.457314 (+ 891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:13.457317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:13.457367 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:13.457433 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:13.458660 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:13.459192 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:13.460758 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:13.461009 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:13.461106 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:13.463786 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:13.463789 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:13.463791 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:13.463817 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:13.465226 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:13.465832 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:13.465835 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:13.465836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:13.465920 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:13.466259 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:13.466263 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:13.466264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:13.466461 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:13.466561 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:13.467100 (+ 539us) server_negotiation.cc:299] Negotiation successful
0812 11:06:13.467239 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:06:13.468339 23973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:13.455548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:38119 (local address 127.18.174.193:42961)
0812 11:06:13.456258 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:13.456311 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:13.457106 (+ 795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:13.457604 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:13.457611 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:13.458000 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:13.458528 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:13.458544 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:13.459348 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:13.459352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:13.460636 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:13.460649 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:13.461178 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:13.461183 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:13.461376 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:13.461949 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:13.461967 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:13.463604 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:13.465350 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:13.465357 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:13.465385 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:13.465730 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:13.466015 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:13.466018 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:13.466021 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:13.466169 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:13.466576 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:13.466584 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:13.466851 (+ 267us) client_negotiation.cc:769] Sending connection context
0812 11:06:13.467038 (+ 187us) client_negotiation.cc:240] Negotiation successful
0812 11:06:13.467388 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":122,"threads_started":1}
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
I20260812 11:06:13.469583 23971 heartbeater.cc:347] Connected to a master server at 127.18.174.254:38119
I20260812 11:06:13.469825 23971 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:13.470311 23971 heartbeater.cc:511] Master 127.18.174.254:38119 requested a full tablet report, sending...
I20260812 11:06:13.471872 23587 ts_manager.cc:194] Registered new tserver with Master: bf274b8509504cc3bbe1c3f2841708d8 (127.18.174.193:37907)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
I20260812 11:06:13.473376 23587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:42961
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:06:13.488642 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:38119
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:39483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:13.603777 23984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:13.604105 23984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:13.604167 23984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:13.608319 23984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:13.608382 23984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:13.608443 23984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:06:13.613955 23984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:38119
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:13.615190 23984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:13.616314 23984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:13.626390 23990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:13.626425 23998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:13.626423 23992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:13.626703 23984 server_base.cc:1034] running on GCE node
I20260812 11:06:13.627110 23984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:13.627786 23984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:13.628983 23984 hybrid_clock.cc:648] HybridClock initialized: now 1786532773628958 us; error 35 us; skew 500 ppm
Aug 12 11:06:13 dist-test-slave-lgr5 krb5kdc[23507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532773, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:13.631800 23984 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:06:13.632800 23984 webserver.cc:460] Webserver started at http://127.18.174.194:44881/ using document root <none> and password file <none>
I20260812 11:06:13.633364 23984 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:13.633424 23984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:13.633595 23984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:13.635752 23984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "3125d052b5f54d07801ad2d374a9a4b0"
format_stamp: "Formatted at 2026-08-12 11:06:13 on dist-test-slave-lgr5"
server_key: "925a90cc136a8bed358fa543487132b8"
server_key_iv: "ac52ea80b95fbd11f90dc058be42189c"
server_key_version: "encryptionkey@0"
I20260812 11:06:13.636360 23984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "3125d052b5f54d07801ad2d374a9a4b0"
format_stamp: "Formatted at 2026-08-12 11:06:13 on dist-test-slave-lgr5"
server_key: "925a90cc136a8bed358fa543487132b8"
server_key_iv: "ac52ea80b95fbd11f90dc058be42189c"
server_key_version: "encryptionkey@0"
I20260812 11:06:13.640166 23984 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:06:13.642640 24006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:13.643922 23984 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:06:13.644048 23984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "3125d052b5f54d07801ad2d374a9a4b0"
format_stamp: "Formatted at 2026-08-12 11:06:13 on dist-test-slave-lgr5"
server_key: "925a90cc136a8bed358fa543487132b8"
server_key_iv: "ac52ea80b95fbd11f90dc058be42189c"
server_key_version: "encryptionkey@0"
I20260812 11:06:13.644201 23984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:13.668308 23984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:13.671898 23984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:13.672148 23984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:13.672832 23984 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:13.673779 23984 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:13.673857 23984 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:13.673936 23984 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:13.673967 23984 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:13.683018 23984 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:36229
I20260812 11:06:13.683043 24199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:36229 every 8 connection(s)
I20260812 11:06:13.683969 23984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:06:13.685678 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 23984
I20260812 11:06:13.685782 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:06:13.686079 19131 external_mini_cluster.cc:1428] Setting key b870bae63940a1c71fa58f69625b1892
Aug 12 11:06:13 dist-test-slave-lgr5 krb5kdc[23507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532773, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
I20260812 11:06:13.698513 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:13.685858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:52601 (local address 127.18.174.254:38119)
0812 11:06:13.686023 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:13.686028 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:13.686970 (+ 942us) server_negotiation.cc:407] Connection header received
0812 11:06:13.688431 (+ 1461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:13.688435 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:13.688489 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:13.688568 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:13.689923 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:13.690452 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:13.692013 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:13.692280 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:13.692382 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:13.695131 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:13.695134 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:13.695137 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:13.695162 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:13.696544 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:13.697032 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:13.697036 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:13.697038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:13.697123 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:13.697500 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:13.697504 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:13.697505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:13.697703 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:13.697790 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:13.698264 (+ 474us) server_negotiation.cc:299] Negotiation successful
0812 11:06:13.698370 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
I20260812 11:06:13.699591 24207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:13.686317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:38119 (local address 127.18.174.194:52601)
0812 11:06:13.686807 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:13.686866 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:13.688226 (+ 1360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:13.688731 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:13.688738 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:13.689110 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:13.689772 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:13.689792 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:13.690576 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:13.690580 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:13.691886 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:13.691898 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:13.692449 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:13.692453 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:13.692660 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:13.693270 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:13.693292 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:13.694937 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:13.696651 (+ 1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:13.696658 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:13.696676 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:13.696936 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:13.697208 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:13.697211 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:13.697213 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:13.697393 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:13.697794 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:13.697799 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:13.698066 (+ 267us) client_negotiation.cc:769] Sending connection context
0812 11:06:13.698230 (+ 164us) client_negotiation.cc:240] Negotiation successful
0812 11:06:13.698612 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":117,"threads_started":1}
I20260812 11:06:13.700805 24201 heartbeater.cc:347] Connected to a master server at 127.18.174.254:38119
I20260812 11:06:13.701058 24201 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:13.701586 24201 heartbeater.cc:511] Master 127.18.174.254:38119 requested a full tablet report, sending...
I20260812 11:06:13.702714 23587 ts_manager.cc:194] Registered new tserver with Master: 3125d052b5f54d07801ad2d374a9a4b0 (127.18.174.194:36229)
I20260812 11:06:13.703449 23587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:52601
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:06:13.715873 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:38119
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:39483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:13.829917 24210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:13.830202 24210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:13.830251 24210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:13.834374 24210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:13.834444 24210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:13.834525 24210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:06:13.839989 24210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:38119
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:13.841174 24210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:13.842227 24210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:13.852311 24219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:13.852308 24216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:13.852362 24210 server_base.cc:1034] running on GCE node
W20260812 11:06:13.852300 24222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:13.852977 24210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:13.853694 24210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:13.854868 24210 hybrid_clock.cc:648] HybridClock initialized: now 1786532773854810 us; error 73 us; skew 500 ppm
Aug 12 11:06:13 dist-test-slave-lgr5 krb5kdc[23507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532773, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:13.857797 24210 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:06:13.858747 24210 webserver.cc:460] Webserver started at http://127.18.174.195:41849/ using document root <none> and password file <none>
I20260812 11:06:13.859319 24210 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:13.859381 24210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:13.859584 24210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:13.861873 24210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "4cc6f7df216d40d8988f8179f213de86"
format_stamp: "Formatted at 2026-08-12 11:06:13 on dist-test-slave-lgr5"
server_key: "b5b6f952c645bc58ec35f9de48182158"
server_key_iv: "26a0f7b3ab3d070a411a0f45d1ea600d"
server_key_version: "encryptionkey@0"
I20260812 11:06:13.862453 24210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "4cc6f7df216d40d8988f8179f213de86"
format_stamp: "Formatted at 2026-08-12 11:06:13 on dist-test-slave-lgr5"
server_key: "b5b6f952c645bc58ec35f9de48182158"
server_key_iv: "26a0f7b3ab3d070a411a0f45d1ea600d"
server_key_version: "encryptionkey@0"
I20260812 11:06:13.866439 24210 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:06:13.869048 24233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:13.870332 24210 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260812 11:06:13.870453 24210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "4cc6f7df216d40d8988f8179f213de86"
format_stamp: "Formatted at 2026-08-12 11:06:13 on dist-test-slave-lgr5"
server_key: "b5b6f952c645bc58ec35f9de48182158"
server_key_iv: "26a0f7b3ab3d070a411a0f45d1ea600d"
server_key_version: "encryptionkey@0"
I20260812 11:06:13.870570 24210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:13.882112 24210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:13.885110 24210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:13.885289 24210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:13.885896 24210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:13.886762 24210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:13.886811 24210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:13.886863 24210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:13.886893 24210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:13.895889 24210 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:45947
I20260812 11:06:13.895912 24435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:45947 every 8 connection(s)
I20260812 11:06:13.896829 24210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:06:13.902667 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 24210
I20260812 11:06:13.902801 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:06:13.903121 19131 external_mini_cluster.cc:1428] Setting key 9f9cd378ec6f9672c61fd3f462320b72
Aug 12 11:06:13 dist-test-slave-lgr5 krb5kdc[23507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532773, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:13.909893 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:13.898596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:39343 (local address 127.18.174.254:38119)
0812 11:06:13.898721 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:13.898724 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:13.899759 (+ 1035us) server_negotiation.cc:407] Connection header received
0812 11:06:13.900633 (+ 874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:13.900636 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:13.900687 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:13.900760 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:13.901910 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:13.902456 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:13.903994 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:13.904285 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:13.904378 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:13.906889 (+ 2511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:13.906892 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:13.906894 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:13.906919 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:13.908141 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:13.908611 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:13.908613 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:13.908614 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:13.908692 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:13.908963 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:13.908965 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:13.908966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:13.909150 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:13.909225 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:13.909677 (+ 452us) server_negotiation.cc:299] Negotiation successful
0812 11:06:13.909773 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:06:13.910724 24440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:13.898938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:38119 (local address 127.18.174.195:39343)
0812 11:06:13.899613 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:13.899656 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:13.900439 (+ 783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:13.900915 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:13.900921 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:13.901275 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:13.901791 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:13.901806 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:13.902572 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:13.902576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:13.903871 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:13.903882 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:13.904449 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:13.904453 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:13.904675 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:13.905291 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:13.905313 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:13.906741 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:13.908247 (+ 1506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:13.908253 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:13.908267 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:13.908529 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:13.908758 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:13.908760 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:13.908761 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:13.908888 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:13.909227 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:13.909232 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:13.909489 (+ 257us) client_negotiation.cc:769] Sending connection context
0812 11:06:13.909648 (+ 159us) client_negotiation.cc:240] Negotiation successful
0812 11:06:13.909904 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":116,"threads_started":1}
I20260812 11:06:13.911808 24437 heartbeater.cc:347] Connected to a master server at 127.18.174.254:38119
I20260812 11:06:13.912031 24437 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:13.912550 24437 heartbeater.cc:511] Master 127.18.174.254:38119 requested a full tablet report, sending...
I20260812 11:06:13.913558 23587 ts_manager.cc:194] Registered new tserver with Master: 4cc6f7df216d40d8988f8179f213de86 (127.18.174.195:45947)
I20260812 11:06:13.914104 23587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:39343
I20260812 11:06:13.916932 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 11:06:13.930510 23657 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:13.929193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48154 (local address 127.18.174.254:38119)
0812 11:06:13.929310 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:13.929313 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:13.929470 (+ 157us) server_negotiation.cc:407] Connection header received
0812 11:06:13.929585 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:13.929587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:13.929630 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:13.929706 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:13.930390 (+ 684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48154: BlockingRecv error: recv got EOF from 127.0.0.1:48154 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:06:13.931579 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 23709
I20260812 11:06:13.946154 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 23984
I20260812 11:06:13.974403 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 24210
I20260812 11:06:13.999878 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 23536
2026-08-12T11:06:14Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2388 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:06:14 dist-test-slave-lgr5 krb5kdc[24455](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:06:14 dist-test-slave-lgr5 krb5kdc[24455](info): set up 2 sockets
Aug 12 11:06:14 dist-test-slave-lgr5 krb5kdc[24455](info): commencing operation
krb5kdc: starting...
W20260812 11:06:15.200309 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:06:15 dist-test-slave-lgr5 krb5kdc[24455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:06:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:06:15.331903 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:39835
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:33775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:39835
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:15.448536 24482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:15.448819 24482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:15.448876 24482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:15.452958 24482 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:15.453027 24482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:15.453052 24482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:15.453073 24482 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:15.453099 24482 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:15.458571 24482 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:33775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:39835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:39835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:15.459800 24482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:15.460896 24482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:15.469910 24492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:15.470014 24482 server_base.cc:1034] running on GCE node
W20260812 11:06:15.469914 24499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:15.469910 24494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:15.470834 24482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:15.471949 24482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:15.473114 24482 hybrid_clock.cc:648] HybridClock initialized: now 1786532775473095 us; error 33 us; skew 500 ppm
Aug 12 11:06:15 dist-test-slave-lgr5 krb5kdc[24455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532775, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:15.475982 24482 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:06:15.477005 24482 webserver.cc:460] Webserver started at http://127.18.174.254:34759/ using document root <none> and password file <none>
I20260812 11:06:15.477583 24482 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:15.477659 24482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:15.477867 24482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:15.480116 24482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "fbc54c5bbd354d9b8b0a94513d2680d3"
format_stamp: "Formatted at 2026-08-12 11:06:15 on dist-test-slave-lgr5"
server_key: "0a57bb424a5cf5460720205b1f851042"
server_key_iv: "8b9e66697b1f735e6e9b2d595fa27b64"
server_key_version: "encryptionkey@0"
I20260812 11:06:15.480711 24482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "fbc54c5bbd354d9b8b0a94513d2680d3"
format_stamp: "Formatted at 2026-08-12 11:06:15 on dist-test-slave-lgr5"
server_key: "0a57bb424a5cf5460720205b1f851042"
server_key_iv: "8b9e66697b1f735e6e9b2d595fa27b64"
server_key_version: "encryptionkey@0"
I20260812 11:06:15.484683 24482 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:06:15.487331 24511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:15.488732 24482 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:15.488924 24482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "fbc54c5bbd354d9b8b0a94513d2680d3"
format_stamp: "Formatted at 2026-08-12 11:06:15 on dist-test-slave-lgr5"
server_key: "0a57bb424a5cf5460720205b1f851042"
server_key_iv: "8b9e66697b1f735e6e9b2d595fa27b64"
server_key_version: "encryptionkey@0"
I20260812 11:06:15.489050 24482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:15.507715 24482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:15.511286 24482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:15.511510 24482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:15.519012 24482 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:39835
I20260812 11:06:15.519367 24608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:39835 every 8 connection(s)
I20260812 11:06:15.520169 24482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:15.523300 24609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:15.529593 24609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3: Bootstrap starting.
I20260812 11:06:15.530076 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 24482
I20260812 11:06:15.530195 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:15.530493 19131 external_mini_cluster.cc:1428] Setting key 207d91686076df6c2d0a0a7135af3a68
I20260812 11:06:15.532567 24609 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:15.533334 24609 log.cc:824] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:15.535704 24609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3: No bootstrap required, opened a new log
Aug 12 11:06:15 dist-test-slave-lgr5 krb5kdc[24455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:15.540113 24609 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc54c5bbd354d9b8b0a94513d2680d3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 39835 } }
I20260812 11:06:15.540443 24609 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:15.540539 24609 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc54c5bbd354d9b8b0a94513d2680d3, State: Initialized, Role: FOLLOWER
I20260812 11:06:15.541040 24609 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc54c5bbd354d9b8b0a94513d2680d3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 39835 } }
I20260812 11:06:15.541229 24609 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:15.541306 24609 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:15.541407 24609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:15.542388 24609 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc54c5bbd354d9b8b0a94513d2680d3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 39835 } }
I20260812 11:06:15.542795 24609 leader_election.cc:302] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbc54c5bbd354d9b8b0a94513d2680d3; no voters:
I20260812 11:06:15.543175 24609 leader_election.cc:288] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:15.543272 24620 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:15.543490 24620 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [term 1 LEADER]: Becoming Leader. State: Replica: fbc54c5bbd354d9b8b0a94513d2680d3, State: Running, Role: LEADER
I20260812 11:06:15.543826 24620 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc54c5bbd354d9b8b0a94513d2680d3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 39835 } }
I20260812 11:06:15.544665 24609 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:15.545598 24624 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbc54c5bbd354d9b8b0a94513d2680d3. Latest consensus state: current_term: 1 leader_uuid: "fbc54c5bbd354d9b8b0a94513d2680d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc54c5bbd354d9b8b0a94513d2680d3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 39835 } } }
I20260812 11:06:15.545732 24624 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:15.545939 24618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:15.531831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37778 (local address 127.18.174.254:39835)
0812 11:06:15.532307 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:15.532325 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:15.532364 (+ 39us) server_negotiation.cc:407] Connection header received
0812 11:06:15.533072 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:15.533093 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:15.533478 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:15.533786 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:15.534660 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:15.536186 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:15.537085 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:15.537837 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:15.538016 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:15.540570 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:15.540577 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:15.540598 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:15.540636 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:15.542348 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:15.542846 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:15.542851 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:15.542856 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:15.543016 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:15.543339 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:15.543343 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:15.543344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:15.543888 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:15.544130 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:15.544552 (+ 422us) server_negotiation.cc:299] Negotiation successful
0812 11:06:15.544881 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":130,"threads_started":1}
I20260812 11:06:15.546072 24622 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbc54c5bbd354d9b8b0a94513d2680d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc54c5bbd354d9b8b0a94513d2680d3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 39835 } } }
I20260812 11:06:15.546160 24622 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:15.546429 24633 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:15.549086 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:06:15.549738 24633 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:15.556056 24633 catalog_manager.cc:1347] Generated new cluster ID: c193e616e0ee4280adaba77747d5e257
I20260812 11:06:15.556145 24633 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:15.571003 24618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:15.564977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37786 (local address 127.18.174.254:39835)
0812 11:06:15.565108 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:15.565113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:15.565409 (+ 296us) server_negotiation.cc:407] Connection header received
0812 11:06:15.565545 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:15.565549 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:15.565605 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:15.565687 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:15.566304 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:15.567083 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:15.568287 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:15.568677 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:15.568774 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:15.569780 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:15.569785 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:15.569788 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:15.570433 (+ 645us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:15.570473 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:15.570508 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:15.570576 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:15.570759 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 11:06:15.570831 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":49}
I20260812 11:06:15.576967 24633 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:15.578375 24633 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:15.604965 24633 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbc54c5bbd354d9b8b0a94513d2680d3: Generated new TSK 0
I20260812 11:06:15.605963 24633 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:06:15.613158 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 24482
2026-08-12T11:06:15Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1620 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:06:15 dist-test-slave-lgr5 krb5kdc[24670](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:06:15 dist-test-slave-lgr5 krb5kdc[24670](info): set up 2 sockets
Aug 12 11:06:15 dist-test-slave-lgr5 krb5kdc[24670](info): commencing operation
krb5kdc: starting...
W20260812 11:06:17.348711 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.698s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:06:17 dist-test-slave-lgr5 krb5kdc[24670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:06:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:06:17.541524 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:33241
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:34021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:33241
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:17.739061 24696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:17.739393 24696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:17.739465 24696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:17.743716 24696 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:17.743791 24696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:17.743819 24696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:17.743839 24696 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:17.743861 24696 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:17.749485 24696 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:34021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:33241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:33241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:17.750674 24696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:17.751766 24696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:17.760602 24706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:17.760639 24708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:17.760689 24696 server_base.cc:1034] running on GCE node
W20260812 11:06:17.760643 24713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:17.761447 24696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:17.762593 24696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:17.763769 24696 hybrid_clock.cc:648] HybridClock initialized: now 1786532777763748 us; error 32 us; skew 500 ppm
Aug 12 11:06:17 dist-test-slave-lgr5 krb5kdc[24670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532777, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:17.771144 24696 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:06:17.772279 24696 webserver.cc:460] Webserver started at http://127.18.174.254:42173/ using document root <none> and password file <none>
I20260812 11:06:17.772874 24696 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:17.772948 24696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:17.773173 24696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:17.775403 24696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "744c50acb983423ba7a61609306a3edf"
format_stamp: "Formatted at 2026-08-12 11:06:17 on dist-test-slave-lgr5"
server_key: "9ed51dea91c5a0fefc9819133ac67cdf"
server_key_iv: "9dfd892ddab308a0212cae14633a8ca4"
server_key_version: "encryptionkey@0"
I20260812 11:06:17.775986 24696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "744c50acb983423ba7a61609306a3edf"
format_stamp: "Formatted at 2026-08-12 11:06:17 on dist-test-slave-lgr5"
server_key: "9ed51dea91c5a0fefc9819133ac67cdf"
server_key_iv: "9dfd892ddab308a0212cae14633a8ca4"
server_key_version: "encryptionkey@0"
I20260812 11:06:17.779954 24696 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 11:06:17.782720 24720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:17.784288 24696 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:17.784441 24696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "744c50acb983423ba7a61609306a3edf"
format_stamp: "Formatted at 2026-08-12 11:06:17 on dist-test-slave-lgr5"
server_key: "9ed51dea91c5a0fefc9819133ac67cdf"
server_key_iv: "9dfd892ddab308a0212cae14633a8ca4"
server_key_version: "encryptionkey@0"
I20260812 11:06:17.784562 24696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:17.799240 24696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:17.802666 24696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:17.802860 24696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:17.809985 24696 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:33241
I20260812 11:06:17.810269 24817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:33241 every 8 connection(s)
I20260812 11:06:17.811017 24696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:17.813872 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 24696
I20260812 11:06:17.814020 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:17.814249 24818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:17.814353 19131 external_mini_cluster.cc:1428] Setting key b4ff37c0bbef8ad4d6b2333910ec56f5
I20260812 11:06:17.821955 24818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf: Bootstrap starting.
Aug 12 11:06:17 dist-test-slave-lgr5 krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:17.824992 24818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:17.825784 24818 log.cc:824] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:17.828181 24818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf: No bootstrap required, opened a new log
I20260812 11:06:17.829655 24823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:17.815807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33048 (local address 127.18.174.254:33241)
0812 11:06:17.816257 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:17.816273 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:17.816314 (+ 41us) server_negotiation.cc:407] Connection header received
0812 11:06:17.817200 (+ 886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:17.817223 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:17.817588 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:17.817895 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:17.818860 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:17.819973 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:17.821201 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:17.821715 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:17.821855 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:17.824805 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:17.824811 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:17.824827 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:17.824862 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:17.826690 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:17.827194 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:17.827198 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:17.827203 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:17.827347 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:17.827641 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:17.827644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:17.827645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:17.828070 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:17.828263 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:17.828556 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 11:06:17.828842 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":117,"threads_started":1}
I20260812 11:06:17.831952 24818 raft_consensus.cc:348] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744c50acb983423ba7a61609306a3edf" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33241 } }
I20260812 11:06:17.832247 24818 raft_consensus.cc:374] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:17.832312 24818 raft_consensus.cc:729] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 744c50acb983423ba7a61609306a3edf, State: Initialized, Role: FOLLOWER
I20260812 11:06:17.832765 24818 consensus_queue.cc:260] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744c50acb983423ba7a61609306a3edf" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33241 } }
I20260812 11:06:17.832904 24818 raft_consensus.cc:388] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:17.832970 24818 raft_consensus.cc:482] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:17.833070 24818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:17.834088 24818 raft_consensus.cc:504] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744c50acb983423ba7a61609306a3edf" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33241 } }
I20260812 11:06:17.834465 24818 leader_election.cc:302] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 744c50acb983423ba7a61609306a3edf; no voters:
I20260812 11:06:17.834815 24818 leader_election.cc:288] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:17.834947 24825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:17.835184 24825 raft_consensus.cc:686] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [term 1 LEADER]: Becoming Leader. State: Replica: 744c50acb983423ba7a61609306a3edf, State: Running, Role: LEADER
I20260812 11:06:17.835618 24825 consensus_queue.cc:237] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744c50acb983423ba7a61609306a3edf" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33241 } }
I20260812 11:06:17.836220 24818 sys_catalog.cc:564] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:17.837478 24827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "744c50acb983423ba7a61609306a3edf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744c50acb983423ba7a61609306a3edf" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33241 } } }
I20260812 11:06:17.837528 24832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 744c50acb983423ba7a61609306a3edf. Latest consensus state: current_term: 1 leader_uuid: "744c50acb983423ba7a61609306a3edf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744c50acb983423ba7a61609306a3edf" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33241 } } }
I20260812 11:06:17.837618 24827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:17.837634 24832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:17.838095 24845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:17.841410 24845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:17.848824 24845 catalog_manager.cc:1347] Generated new cluster ID: 7356813a787f42eaab0421466fbfa07b
I20260812 11:06:17.848918 24845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:17.866216 24845 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:17.867218 24845 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:17.875963 24845 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 744c50acb983423ba7a61609306a3edf: Generated new TSK 0
I20260812 11:06:17.876979 24845 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:06:17.906718 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33241
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:34021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:18.031220 24867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:18.031513 24867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:18.031574 24867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:18.035802 24867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:18.035887 24867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:18.035971 24867 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:18.041780 24867 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:34021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:18.042958 24867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:18.044121 24867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:18.054330 24875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:18.054375 24882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:18.054553 24867 server_base.cc:1034] running on GCE node
W20260812 11:06:18.054363 24873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:18.055680 24867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:18.056445 24867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:18.057616 24867 hybrid_clock.cc:648] HybridClock initialized: now 1786532778057585 us; error 50 us; skew 500 ppm
Aug 12 11:06:18 dist-test-slave-lgr5 krb5kdc[24670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532778, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:18.060551 24867 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:06:18.061555 24867 webserver.cc:460] Webserver started at http://127.18.174.193:36047/ using document root <none> and password file <none>
I20260812 11:06:18.062160 24867 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:18.062232 24867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:18.062438 24867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:18.064772 24867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "211be757ba494ac6b30c523e8de282cb"
format_stamp: "Formatted at 2026-08-12 11:06:18 on dist-test-slave-lgr5"
server_key: "94ca6027b76d6d3e66b8abe24b9de4b1"
server_key_iv: "121473148a21ff4c179db3588af3f5d6"
server_key_version: "encryptionkey@0"
I20260812 11:06:18.065369 24867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "211be757ba494ac6b30c523e8de282cb"
format_stamp: "Formatted at 2026-08-12 11:06:18 on dist-test-slave-lgr5"
server_key: "94ca6027b76d6d3e66b8abe24b9de4b1"
server_key_iv: "121473148a21ff4c179db3588af3f5d6"
server_key_version: "encryptionkey@0"
I20260812 11:06:18.069381 24867 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:06:18.071869 24893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:18.073262 24867 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:18.073396 24867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "211be757ba494ac6b30c523e8de282cb"
format_stamp: "Formatted at 2026-08-12 11:06:18 on dist-test-slave-lgr5"
server_key: "94ca6027b76d6d3e66b8abe24b9de4b1"
server_key_iv: "121473148a21ff4c179db3588af3f5d6"
server_key_version: "encryptionkey@0"
I20260812 11:06:18.073511 24867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:18.098151 24867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:18.101406 24867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:18.101581 24867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:18.102190 24867 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:18.103119 24867 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:18.103169 24867 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:18.103211 24867 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:18.103231 24867 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:18.112344 24867 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:33963
I20260812 11:06:18.112396 25094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:33963 every 8 connection(s)
I20260812 11:06:18.113368 24867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:06:18.114869 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 24867
I20260812 11:06:18.114967 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:06:18.115293 19131 external_mini_cluster.cc:1428] Setting key bee04a0d9d4747144c9281c861b7ce9b
Aug 12 11:06:18 dist-test-slave-lgr5 krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532778, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
I20260812 11:06:18.127902 24823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:18.115328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:38681 (local address 127.18.174.254:33241)
0812 11:06:18.115481 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:18.115485 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:18.116502 (+ 1017us) server_negotiation.cc:407] Connection header received
0812 11:06:18.117905 (+ 1403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:18.117908 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:18.117962 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:18.118049 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:18.119255 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:18.120042 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:18.121298 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:18.121665 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:18.121777 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:18.124335 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:18.124340 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:18.124343 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:18.124376 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:18.125817 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:18.126400 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:18.126405 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:18.126406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:18.126505 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:18.126806 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:18.126808 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:18.126809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:18.126997 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:18.127073 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:18.127634 (+ 561us) server_negotiation.cc:299] Negotiation successful
0812 11:06:18.127759 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
I20260812 11:06:18.128923 25098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:18.115796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:33241 (local address 127.18.174.193:38681)
0812 11:06:18.116327 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:18.116386 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:18.117683 (+ 1297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:18.118189 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:18.118196 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:18.118576 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:18.119097 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:18.119112 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:18.120213 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:18.120216 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:18.121156 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:18.121168 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:18.121825 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:18.121828 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:18.121996 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:18.122586 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:18.122604 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:18.124137 (+ 1533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:18.125937 (+ 1800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:18.125942 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:18.125957 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:18.126291 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:18.126585 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:18.126587 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:18.126589 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:18.126736 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:18.127071 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:18.127076 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:18.127405 (+ 329us) client_negotiation.cc:769] Sending connection context
0812 11:06:18.127575 (+ 170us) client_negotiation.cc:240] Negotiation successful
0812 11:06:18.127911 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":140,"threads_started":1}
I20260812 11:06:18.131091 25095 heartbeater.cc:347] Connected to a master server at 127.18.174.254:33241
I20260812 11:06:18.131343 25095 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:18.131873 25095 heartbeater.cc:511] Master 127.18.174.254:33241 requested a full tablet report, sending...
I20260812 11:06:18.133780 24754 ts_manager.cc:194] Registered new tserver with Master: 211be757ba494ac6b30c523e8de282cb (127.18.174.193:33963)
I20260812 11:06:18.135481 24754 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:38681
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:06:18.145466 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33241
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:34021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:18.261044 25103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:18.261351 25103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:18.261402 25103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:18.265548 25103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:18.265628 25103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:18.265691 25103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:06:18.271265 25103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:34021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:18.272487 25103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:18.273577 25103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:18.284112 25115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:18.284067 25114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:18.284262 25103 server_base.cc:1034] running on GCE node
W20260812 11:06:18.284067 25124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:18.284963 25103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:18.285670 25103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:18.286870 25103 hybrid_clock.cc:648] HybridClock initialized: now 1786532778286850 us; error 26 us; skew 500 ppm
Aug 12 11:06:18 dist-test-slave-lgr5 krb5kdc[24670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532778, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:18.290129 25103 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:06:18.291206 25103 webserver.cc:460] Webserver started at http://127.18.174.194:41685/ using document root <none> and password file <none>
I20260812 11:06:18.291826 25103 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:18.291898 25103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:18.292151 25103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:18.294433 25103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "e5131024cc5a43098e68322992e6f33a"
format_stamp: "Formatted at 2026-08-12 11:06:18 on dist-test-slave-lgr5"
server_key: "80f1e2d0ef24ea066d65c101003ebc3f"
server_key_iv: "0cabfd41c4ed20b98742d1d3f1e4557e"
server_key_version: "encryptionkey@0"
I20260812 11:06:18.295133 25103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "e5131024cc5a43098e68322992e6f33a"
format_stamp: "Formatted at 2026-08-12 11:06:18 on dist-test-slave-lgr5"
server_key: "80f1e2d0ef24ea066d65c101003ebc3f"
server_key_iv: "0cabfd41c4ed20b98742d1d3f1e4557e"
server_key_version: "encryptionkey@0"
I20260812 11:06:18.299369 25103 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260812 11:06:18.302357 25141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:18.304128 25103 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 11:06:18.304284 25103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "e5131024cc5a43098e68322992e6f33a"
format_stamp: "Formatted at 2026-08-12 11:06:18 on dist-test-slave-lgr5"
server_key: "80f1e2d0ef24ea066d65c101003ebc3f"
server_key_iv: "0cabfd41c4ed20b98742d1d3f1e4557e"
server_key_version: "encryptionkey@0"
I20260812 11:06:18.304417 25103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:18.317050 25103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:18.320602 25103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:18.320788 25103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:18.321421 25103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:18.322296 25103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:18.322356 25103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:18.322412 25103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:18.322438 25103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:18.331296 25103 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:43531
I20260812 11:06:18.331322 25358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:43531 every 8 connection(s)
I20260812 11:06:18.332347 25103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:06:18.332520 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 25103
I20260812 11:06:18.332633 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:06:18.332928 19131 external_mini_cluster.cc:1428] Setting key aadbc8fac50ec02c474feb2b2a149615
Aug 12 11:06:18 dist-test-slave-lgr5 krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532778, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
I20260812 11:06:18.346993 24823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:18.334250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:38781 (local address 127.18.174.254:33241)
0812 11:06:18.334414 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:18.334419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:18.335370 (+ 951us) server_negotiation.cc:407] Connection header received
0812 11:06:18.336948 (+ 1578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:18.336951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:18.337010 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:18.337086 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:18.338483 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:18.339019 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:18.340235 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:18.340478 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:18.340574 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:18.343329 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:18.343332 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:18.343334 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:18.343362 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:18.344748 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:18.345355 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:18.345358 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:18.345359 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:18.345446 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:18.345831 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:18.345834 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:18.345836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:18.346052 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:18.346134 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:18.346695 (+ 561us) server_negotiation.cc:299] Negotiation successful
0812 11:06:18.346828 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
I20260812 11:06:18.347841 25362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:18.334691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:33241 (local address 127.18.174.194:38781)
0812 11:06:18.335209 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:18.335258 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:18.336709 (+ 1451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:18.337293 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:18.337300 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:18.337708 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:18.338294 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:18.338328 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:18.339153 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:18.339156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:18.340116 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:18.340129 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:18.340638 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:18.340642 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:18.340835 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:18.341425 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:18.341442 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:18.343138 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:18.344935 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:18.344943 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:18.344963 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:18.345261 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:18.345533 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:18.345535 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:18.345537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:18.345686 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:18.346153 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:18.346159 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:18.346439 (+ 280us) client_negotiation.cc:769] Sending connection context
0812 11:06:18.346618 (+ 179us) client_negotiation.cc:240] Negotiation successful
0812 11:06:18.346905 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":130,"threads_started":1}
I20260812 11:06:18.349090 25359 heartbeater.cc:347] Connected to a master server at 127.18.174.254:33241
I20260812 11:06:18.349365 25359 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:18.349954 25359 heartbeater.cc:511] Master 127.18.174.254:33241 requested a full tablet report, sending...
I20260812 11:06:18.351408 24754 ts_manager.cc:194] Registered new tserver with Master: e5131024cc5a43098e68322992e6f33a (127.18.174.194:43531)
I20260812 11:06:18.352180 24754 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:38781
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:06:18.366966 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33241
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:34021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:18.483918 25365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:18.484254 25365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:18.484303 25365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:18.488452 25365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:18.488521 25365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:18.488581 25365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:06:18.494350 25365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:34021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:18.495491 25365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:18.496582 25365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:18.506892 25372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:18.506892 25371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:18.506898 25376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:18.506963 25365 server_base.cc:1034] running on GCE node
I20260812 11:06:18.507676 25365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:18.508466 25365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:18.509671 25365 hybrid_clock.cc:648] HybridClock initialized: now 1786532778509653 us; error 50 us; skew 500 ppm
Aug 12 11:06:18 dist-test-slave-lgr5 krb5kdc[24670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532778, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:18.512571 25365 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:06:18.513506 25365 webserver.cc:460] Webserver started at http://127.18.174.195:36209/ using document root <none> and password file <none>
I20260812 11:06:18.514045 25365 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:18.514103 25365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:18.514277 25365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:18.516417 25365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "3a7b3a9c9cac4ab3afba943477f54fc8"
format_stamp: "Formatted at 2026-08-12 11:06:18 on dist-test-slave-lgr5"
server_key: "8765779352a452572ffe4839adaeccb9"
server_key_iv: "8e7bebbf0fe17337e8acbf8edd2859dd"
server_key_version: "encryptionkey@0"
I20260812 11:06:18.516944 25365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "3a7b3a9c9cac4ab3afba943477f54fc8"
format_stamp: "Formatted at 2026-08-12 11:06:18 on dist-test-slave-lgr5"
server_key: "8765779352a452572ffe4839adaeccb9"
server_key_iv: "8e7bebbf0fe17337e8acbf8edd2859dd"
server_key_version: "encryptionkey@0"
I20260812 11:06:18.520776 25365 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:06:18.523332 25392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:18.524829 25365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:18.524974 25365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "3a7b3a9c9cac4ab3afba943477f54fc8"
format_stamp: "Formatted at 2026-08-12 11:06:18 on dist-test-slave-lgr5"
server_key: "8765779352a452572ffe4839adaeccb9"
server_key_iv: "8e7bebbf0fe17337e8acbf8edd2859dd"
server_key_version: "encryptionkey@0"
I20260812 11:06:18.525091 25365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:18.552268 25365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:18.555704 25365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:18.555895 25365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:18.556589 25365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:18.557526 25365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:18.557576 25365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:18.557623 25365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:18.557651 25365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:18.566416 25365 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:42683
I20260812 11:06:18.566483 25599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:42683 every 8 connection(s)
I20260812 11:06:18.567462 25365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:06:18.574524 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 25365
I20260812 11:06:18.574643 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:06:18.574913 19131 external_mini_cluster.cc:1428] Setting key ad4f5db9788e787d05d462138784e693
Aug 12 11:06:18 dist-test-slave-lgr5 krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532778, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:18.581633 24823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:18.569394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:43473 (local address 127.18.174.254:33241)
0812 11:06:18.569556 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:18.569560 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:18.570536 (+ 976us) server_negotiation.cc:407] Connection header received
0812 11:06:18.571909 (+ 1373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:18.571912 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:18.571965 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:18.572032 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:18.573388 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:18.573926 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:18.575140 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:18.575432 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:18.575549 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:18.578200 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:18.578204 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:18.578207 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:18.578235 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:18.579454 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:18.579992 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:18.579996 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:18.579998 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:18.580111 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:18.580440 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:18.580443 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:18.580445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:18.580657 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:18.580747 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:18.581316 (+ 569us) server_negotiation.cc:299] Negotiation successful
0812 11:06:18.581457 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:06:18.582474 25605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:18.569845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:33241 (local address 127.18.174.195:43473)
0812 11:06:18.570350 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:18.570397 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:18.571676 (+ 1279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:18.572282 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:18.572290 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:18.572710 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:18.573250 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:18.573266 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:18.574023 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:18.574025 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:18.575019 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:18.575031 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:18.575603 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:18.575607 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:18.575789 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:18.576436 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:18.576454 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:18.578032 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:18.579598 (+ 1566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:18.579604 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:18.579624 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:18.579894 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:18.580189 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:18.580192 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:18.580194 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:18.580347 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:18.580764 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:18.580772 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:18.581063 (+ 291us) client_negotiation.cc:769] Sending connection context
0812 11:06:18.581247 (+ 184us) client_negotiation.cc:240] Negotiation successful
0812 11:06:18.581609 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":149,"threads_started":1}
I20260812 11:06:18.583636 25601 heartbeater.cc:347] Connected to a master server at 127.18.174.254:33241
I20260812 11:06:18.583891 25601 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:18.584637 25601 heartbeater.cc:511] Master 127.18.174.254:33241 requested a full tablet report, sending...
I20260812 11:06:18.585940 24754 ts_manager.cc:194] Registered new tserver with Master: 3a7b3a9c9cac4ab3afba943477f54fc8 (127.18.174.195:42683)
I20260812 11:06:18.586704 24754 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:43473
I20260812 11:06:18.588881 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:06:18 dist-test-slave-lgr5 krb5kdc[24670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532778, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 11:06:18 dist-test-slave-lgr5 krb5kdc[24670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532778, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:18.615389 24823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:18.607239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33050 (local address 127.18.174.254:33241)
0812 11:06:18.607468 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:18.607472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:18.607559 (+ 87us) server_negotiation.cc:407] Connection header received
0812 11:06:18.607730 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:18.607734 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:18.607786 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:18.607887 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:18.608625 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:18.609183 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:18.609977 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:18.610181 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:18.610244 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:18.612601 (+ 2357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:18.612604 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:18.612606 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:18.612634 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:18.613964 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:18.614304 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:18.614306 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:18.614307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:18.614379 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:18.614608 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:18.614610 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:18.614611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:18.614833 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:18.614933 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:18.615127 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 11:06:18.615226 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
W20260812 11:06:18.615836 24754 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:33050
I20260812 11:06:18.616717 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 24867
I20260812 11:06:18.629716 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 25103
I20260812 11:06:18.640667 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 25365
I20260812 11:06:18.662427 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 24696
2026-08-12T11:06:18Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3040 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:06:18 dist-test-slave-lgr5 krb5kdc[25625](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:06:18 dist-test-slave-lgr5 krb5kdc[25625](info): set up 2 sockets
Aug 12 11:06:18 dist-test-slave-lgr5 krb5kdc[25625](info): commencing operation
krb5kdc: starting...
W20260812 11:06:19.902614 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:06:19 dist-test-slave-lgr5 krb5kdc[25625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:06:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:06:20.031888 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45409
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:35007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:45409
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:20.145082 25653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:20.145375 25653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:20.145434 25653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:20.149466 25653 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:20.149534 25653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:20.149560 25653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:20.149581 25653 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:20.149601 25653 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:20.155052 25653 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:35007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:45409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:20.156267 25653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:20.157511 25653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:20.166550 25661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:20.166553 25666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:20.166553 25663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:20.166877 25653 server_base.cc:1034] running on GCE node
I20260812 11:06:20.167528 25653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:20.168774 25653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:20.169965 25653 hybrid_clock.cc:648] HybridClock initialized: now 1786532780169941 us; error 39 us; skew 500 ppm
Aug 12 11:06:20 dist-test-slave-lgr5 krb5kdc[25625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532780, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:20.173070 25653 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:06:20.174064 25653 webserver.cc:460] Webserver started at http://127.18.174.254:40203/ using document root <none> and password file <none>
I20260812 11:06:20.174641 25653 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:20.174703 25653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:20.174880 25653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:20.177155 25653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "000f54d8e4cd4269849df3309a454bc5"
format_stamp: "Formatted at 2026-08-12 11:06:20 on dist-test-slave-lgr5"
server_key: "80ca36291b7b935df4b7de8d12e15f4b"
server_key_iv: "1732b6f5239bddd4df2769aff9afbebe"
server_key_version: "encryptionkey@0"
I20260812 11:06:20.177732 25653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "000f54d8e4cd4269849df3309a454bc5"
format_stamp: "Formatted at 2026-08-12 11:06:20 on dist-test-slave-lgr5"
server_key: "80ca36291b7b935df4b7de8d12e15f4b"
server_key_iv: "1732b6f5239bddd4df2769aff9afbebe"
server_key_version: "encryptionkey@0"
I20260812 11:06:20.181665 25653 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:06:20.184239 25679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:20.185559 25653 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:20.185678 25653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "000f54d8e4cd4269849df3309a454bc5"
format_stamp: "Formatted at 2026-08-12 11:06:20 on dist-test-slave-lgr5"
server_key: "80ca36291b7b935df4b7de8d12e15f4b"
server_key_iv: "1732b6f5239bddd4df2769aff9afbebe"
server_key_version: "encryptionkey@0"
I20260812 11:06:20.185802 25653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:20.203385 25653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:20.206939 25653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:20.207151 25653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:20.214498 25653 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:45409
I20260812 11:06:20.214521 25776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:45409 every 8 connection(s)
I20260812 11:06:20.215581 25653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:20.218616 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 25653
I20260812 11:06:20.218642 25777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:20.218734 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:20.219010 19131 external_mini_cluster.cc:1428] Setting key aae01c033151b977de9df4a738cb7561
I20260812 11:06:20.226184 25777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5: Bootstrap starting.
Aug 12 11:06:20 dist-test-slave-lgr5 krb5kdc[25625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:20.228811 25777 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:20.229598 25777 log.cc:824] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:20.231750 25777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5: No bootstrap required, opened a new log
I20260812 11:06:20.233309 25786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:20.220423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47608 (local address 127.18.174.254:45409)
0812 11:06:20.220875 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:20.220891 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:20.220932 (+ 41us) server_negotiation.cc:407] Connection header received
0812 11:06:20.221643 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:20.221664 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:20.222042 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:20.222391 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:20.223270 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:20.224377 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:20.225290 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:20.225819 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:20.225989 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:20.228584 (+ 2595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:20.228591 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:20.228608 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:20.228645 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:20.230356 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:20.230818 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:20.230824 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:20.230830 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:20.230951 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:20.231235 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:20.231238 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:20.231239 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:20.231689 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:20.231871 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:20.232230 (+ 359us) server_negotiation.cc:299] Negotiation successful
0812 11:06:20.232552 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":132,"threads_started":1}
I20260812 11:06:20.236003 25777 raft_consensus.cc:348] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "000f54d8e4cd4269849df3309a454bc5" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45409 } }
I20260812 11:06:20.236308 25777 raft_consensus.cc:374] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:20.236385 25777 raft_consensus.cc:729] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 000f54d8e4cd4269849df3309a454bc5, State: Initialized, Role: FOLLOWER
I20260812 11:06:20.236824 25777 consensus_queue.cc:260] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "000f54d8e4cd4269849df3309a454bc5" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45409 } }
I20260812 11:06:20.236980 25777 raft_consensus.cc:388] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:20.237047 25777 raft_consensus.cc:482] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:20.237154 25777 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:20.238176 25777 raft_consensus.cc:504] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "000f54d8e4cd4269849df3309a454bc5" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45409 } }
I20260812 11:06:20.238571 25777 leader_election.cc:302] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 000f54d8e4cd4269849df3309a454bc5; no voters:
I20260812 11:06:20.238988 25777 leader_election.cc:288] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:20.239080 25789 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:20.239296 25789 raft_consensus.cc:686] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [term 1 LEADER]: Becoming Leader. State: Replica: 000f54d8e4cd4269849df3309a454bc5, State: Running, Role: LEADER
I20260812 11:06:20.239683 25789 consensus_queue.cc:237] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "000f54d8e4cd4269849df3309a454bc5" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45409 } }
I20260812 11:06:20.240381 25777 sys_catalog.cc:564] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:20.241470 25792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 000f54d8e4cd4269849df3309a454bc5. Latest consensus state: current_term: 1 leader_uuid: "000f54d8e4cd4269849df3309a454bc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "000f54d8e4cd4269849df3309a454bc5" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45409 } } }
I20260812 11:06:20.241472 25790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "000f54d8e4cd4269849df3309a454bc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "000f54d8e4cd4269849df3309a454bc5" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45409 } } }
I20260812 11:06:20.241633 25790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:20.241633 25792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:20.242097 25804 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:20.245646 25804 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:20.251806 25804 catalog_manager.cc:1347] Generated new cluster ID: d3d7fb198dfd4e65a5c04e254f175f40
I20260812 11:06:20.251891 25804 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:20.267076 25804 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:20.268498 25804 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:20.274641 25804 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 000f54d8e4cd4269849df3309a454bc5: Generated new TSK 0
I20260812 11:06:20.275404 25804 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:06:20.310884 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45409
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:35007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:20.458925 25824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:20.459285 25824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:20.459349 25824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:20.463485 25824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:20.463547 25824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:20.463605 25824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:20.468957 25824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:35007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:20.470016 25824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:20.471037 25824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:20.481225 25832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:20.481225 25831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:20.481284 25824 server_base.cc:1034] running on GCE node
W20260812 11:06:20.481225 25835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:20.481963 25824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:20.482661 25824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:20.483824 25824 hybrid_clock.cc:648] HybridClock initialized: now 1786532780483804 us; error 31 us; skew 500 ppm
Aug 12 11:06:20 dist-test-slave-lgr5 krb5kdc[25625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532780, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:20.486595 25824 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:06:20.487497 25824 webserver.cc:460] Webserver started at http://127.18.174.193:40417/ using document root <none> and password file <none>
I20260812 11:06:20.488116 25824 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:20.488191 25824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:20.488435 25824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:20.490625 25824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "7033e0d6330143deb1b94feae5e3feaa"
format_stamp: "Formatted at 2026-08-12 11:06:20 on dist-test-slave-lgr5"
server_key: "a35c7d96480d48aaf28262826221fc28"
server_key_iv: "d6c7c50e724f8e104be89b5e8178fb33"
server_key_version: "encryptionkey@0"
I20260812 11:06:20.491205 25824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "7033e0d6330143deb1b94feae5e3feaa"
format_stamp: "Formatted at 2026-08-12 11:06:20 on dist-test-slave-lgr5"
server_key: "a35c7d96480d48aaf28262826221fc28"
server_key_iv: "d6c7c50e724f8e104be89b5e8178fb33"
server_key_version: "encryptionkey@0"
I20260812 11:06:20.495301 25824 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 11:06:20.498036 25849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:20.499359 25824 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:20.499503 25824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "7033e0d6330143deb1b94feae5e3feaa"
format_stamp: "Formatted at 2026-08-12 11:06:20 on dist-test-slave-lgr5"
server_key: "a35c7d96480d48aaf28262826221fc28"
server_key_iv: "d6c7c50e724f8e104be89b5e8178fb33"
server_key_version: "encryptionkey@0"
I20260812 11:06:20.499616 25824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:20.518857 25824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:20.522217 25824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:20.522415 25824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:20.523087 25824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:20.524185 25824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:20.524236 25824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:20.524279 25824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:20.524299 25824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:20.532701 25824 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:42135
I20260812 11:06:20.532723 26048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:42135 every 8 connection(s)
I20260812 11:06:20.533596 25824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:06:20.539333 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 25824
I20260812 11:06:20.539463 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:06:20.539752 19131 external_mini_cluster.cc:1428] Setting key 897657bc62276280d8a848a8480bd602
Aug 12 11:06:20 dist-test-slave-lgr5 krb5kdc[25625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532780, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:20.548030 25786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:20.535419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:33567 (local address 127.18.174.254:45409)
0812 11:06:20.535593 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:20.535598 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:20.536489 (+ 891us) server_negotiation.cc:407] Connection header received
0812 11:06:20.537834 (+ 1345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:20.537837 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:20.537886 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:20.537960 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:20.539141 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:20.539940 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:20.541460 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:20.541781 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:20.541919 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:20.544411 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:20.544415 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:20.544417 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:20.544441 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:20.545779 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:20.546412 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:20.546415 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:20.546416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:20.546498 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:20.546866 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:20.546868 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:20.546869 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:20.547052 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:20.547124 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:20.547772 (+ 648us) server_negotiation.cc:299] Negotiation successful
0812 11:06:20.547901 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 11:06:20.549268 26051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:20.535832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45409 (local address 127.18.174.193:33567)
0812 11:06:20.536344 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:20.536390 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:20.537639 (+ 1249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:20.538130 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:20.538137 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:20.538504 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:20.539003 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:20.539018 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:20.540059 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:20.540062 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:20.541359 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:20.541371 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:20.541966 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:20.541981 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:20.542158 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:20.542751 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:20.542767 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:20.544244 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:20.545906 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:20.545912 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:20.545930 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:20.546306 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:20.546581 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:20.546585 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:20.546587 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:20.546780 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:20.547149 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:20.547156 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:20.547513 (+ 357us) client_negotiation.cc:769] Sending connection context
0812 11:06:20.547737 (+ 224us) client_negotiation.cc:240] Negotiation successful
0812 11:06:20.548156 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":114,"threads_started":1}
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
I20260812 11:06:20.550594 26049 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45409
I20260812 11:06:20.550840 26049 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:20.551357 26049 heartbeater.cc:511] Master 127.18.174.254:45409 requested a full tablet report, sending...
I20260812 11:06:20.553022 25716 ts_manager.cc:194] Registered new tserver with Master: 7033e0d6330143deb1b94feae5e3feaa (127.18.174.193:42135)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
I20260812 11:06:20.554292 25716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:33567
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:06:20.570889 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45409
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:35007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:20.687013 26055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:20.687292 26055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:20.687336 26055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:20.691496 26055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:20.691572 26055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:20.691634 26055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:06:20.697233 26055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:35007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26055
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:20.698343 26055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:20.699401 26055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:06:20.709575 26055 server_base.cc:1034] running on GCE node
W20260812 11:06:20.709748 26067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:20.709767 26064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:20.709867 26063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:20.710286 26055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:20.710922 26055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:20.712105 26055 hybrid_clock.cc:648] HybridClock initialized: now 1786532780712057 us; error 33 us; skew 500 ppm
Aug 12 11:06:20 dist-test-slave-lgr5 krb5kdc[25625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532780, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:20.715010 26055 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:06:20.716024 26055 webserver.cc:460] Webserver started at http://127.18.174.194:45935/ using document root <none> and password file <none>
I20260812 11:06:20.716660 26055 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:20.716737 26055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:20.716957 26055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:20.719223 26055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "949a6edfeac74515a0efbb2801138b90"
format_stamp: "Formatted at 2026-08-12 11:06:20 on dist-test-slave-lgr5"
server_key: "bf307445db51271dcd3ab1a450beb25f"
server_key_iv: "2eb52ab8847c141ab591823798035944"
server_key_version: "encryptionkey@0"
I20260812 11:06:20.719838 26055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "949a6edfeac74515a0efbb2801138b90"
format_stamp: "Formatted at 2026-08-12 11:06:20 on dist-test-slave-lgr5"
server_key: "bf307445db51271dcd3ab1a450beb25f"
server_key_iv: "2eb52ab8847c141ab591823798035944"
server_key_version: "encryptionkey@0"
I20260812 11:06:20.723809 26055 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:06:20.726399 26076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:20.727710 26055 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 11:06:20.727824 26055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "949a6edfeac74515a0efbb2801138b90"
format_stamp: "Formatted at 2026-08-12 11:06:20 on dist-test-slave-lgr5"
server_key: "bf307445db51271dcd3ab1a450beb25f"
server_key_iv: "2eb52ab8847c141ab591823798035944"
server_key_version: "encryptionkey@0"
I20260812 11:06:20.727932 26055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:20.748659 26055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:20.751822 26055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:20.752015 26055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:20.752677 26055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:20.753566 26055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:20.753614 26055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:20.753670 26055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:20.753697 26055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:20.762427 26055 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:42171
I20260812 11:06:20.762445 26267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:42171 every 8 connection(s)
I20260812 11:06:20.763389 26055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:06:20.768203 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 26055
I20260812 11:06:20.768335 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:06:20.768610 19131 external_mini_cluster.cc:1428] Setting key 951a5e6ff17b0d37e7109b8e7a949875
Aug 12 11:06:20 dist-test-slave-lgr5 krb5kdc[25625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532780, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:20.779770 25786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:20.765362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:45443 (local address 127.18.174.254:45409)
0812 11:06:20.765529 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:20.765533 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:20.766413 (+ 880us) server_negotiation.cc:407] Connection header received
0812 11:06:20.767827 (+ 1414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:20.767831 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:20.767898 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:20.767996 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:20.769673 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:20.770365 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:20.771681 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:20.771985 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:20.772129 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:20.775564 (+ 3435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:20.775567 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:20.775570 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:20.775600 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:20.777098 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:20.777851 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:20.777853 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:20.777855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:20.777929 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:20.778409 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:20.778413 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:20.778414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:20.778645 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:20.778736 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:20.779504 (+ 768us) server_negotiation.cc:299] Negotiation successful
0812 11:06:20.779636 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
I20260812 11:06:20.781019 26272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:20.765751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45409 (local address 127.18.174.194:45443)
0812 11:06:20.766246 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:20.766293 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:20.767578 (+ 1285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:20.768267 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:20.768274 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:20.768775 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:20.769474 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:20.769500 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:20.770534 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:20.770537 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:20.771532 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:20.771545 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:20.772225 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:20.772230 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:20.772514 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:20.773231 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:20.773267 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:20.775312 (+ 2045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:20.777262 (+ 1950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:20.777272 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:20.777295 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:20.777736 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:20.778018 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:20.778022 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:20.778024 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:20.778265 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:20.778770 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:20.778779 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:20.779183 (+ 404us) client_negotiation.cc:769] Sending connection context
0812 11:06:20.779470 (+ 287us) client_negotiation.cc:240] Negotiation successful
0812 11:06:20.779907 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":128,"threads_started":1}
I20260812 11:06:20.782346 26269 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45409
I20260812 11:06:20.782629 26269 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:20.783159 26269 heartbeater.cc:511] Master 127.18.174.254:45409 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
I20260812 11:06:20.784437 25716 ts_manager.cc:194] Registered new tserver with Master: 949a6edfeac74515a0efbb2801138b90 (127.18.174.194:42171)
I20260812 11:06:20.785073 25716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:45443
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:06:20.803495 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45409
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:35007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:20.923381 26276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:20.923688 26276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:20.923758 26276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:20.927881 26276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:20.927968 26276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:20.928064 26276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:06:20.933651 26276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:35007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:20.934799 26276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:20.935896 26276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:20.946112 26282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:20.946111 26284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:20.946112 26281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:20.946302 26276 server_base.cc:1034] running on GCE node
I20260812 11:06:20.946902 26276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:20.947590 26276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:20.948787 26276 hybrid_clock.cc:648] HybridClock initialized: now 1786532780948767 us; error 29 us; skew 500 ppm
Aug 12 11:06:20 dist-test-slave-lgr5 krb5kdc[25625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532780, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:20.951609 26276 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:06:20.952625 26276 webserver.cc:460] Webserver started at http://127.18.174.195:41567/ using document root <none> and password file <none>
I20260812 11:06:20.953176 26276 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:20.953235 26276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:20.953428 26276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:20.955533 26276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "4d68c871375a448aadb8e5004b75d114"
format_stamp: "Formatted at 2026-08-12 11:06:20 on dist-test-slave-lgr5"
server_key: "c72d2ee1f1885da5fc96f67f656c3e1e"
server_key_iv: "cda92f29c3f91db4beb3d923543e86a0"
server_key_version: "encryptionkey@0"
I20260812 11:06:20.956066 26276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "4d68c871375a448aadb8e5004b75d114"
format_stamp: "Formatted at 2026-08-12 11:06:20 on dist-test-slave-lgr5"
server_key: "c72d2ee1f1885da5fc96f67f656c3e1e"
server_key_iv: "cda92f29c3f91db4beb3d923543e86a0"
server_key_version: "encryptionkey@0"
I20260812 11:06:20.959996 26276 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 11:06:20.962564 26294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:20.963790 26276 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:06:20.963896 26276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "4d68c871375a448aadb8e5004b75d114"
format_stamp: "Formatted at 2026-08-12 11:06:20 on dist-test-slave-lgr5"
server_key: "c72d2ee1f1885da5fc96f67f656c3e1e"
server_key_iv: "cda92f29c3f91db4beb3d923543e86a0"
server_key_version: "encryptionkey@0"
I20260812 11:06:20.964006 26276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:20.981817 26276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:20.984985 26276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:20.985179 26276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:20.985826 26276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:20.986733 26276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:20.986783 26276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:20.986830 26276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:20.986860 26276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:20.995975 26276 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:34485
I20260812 11:06:20.996002 26495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:34485 every 8 connection(s)
I20260812 11:06:20.996975 26276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:06:21.001055 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 26276
I20260812 11:06:21.001174 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:06:21.001437 19131 external_mini_cluster.cc:1428] Setting key ed0704cbdba2778fd6bcdc554f461434
Aug 12 11:06:21 dist-test-slave-lgr5 krb5kdc[25625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532780, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:21.011255 25786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:20.998866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:43093 (local address 127.18.174.254:45409)
0812 11:06:20.998997 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:20.999001 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:20.999885 (+ 884us) server_negotiation.cc:407] Connection header received
0812 11:06:21.001323 (+ 1438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:21.001327 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:21.001399 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:21.001476 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:21.003052 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:21.003696 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:21.004943 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:21.005176 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:21.005267 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:21.007765 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:21.007769 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:21.007771 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:21.007800 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:21.009089 (+ 1289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:21.009652 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:21.009656 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:21.009657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:21.009743 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:21.010080 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:21.010084 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:21.010086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:21.010285 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:21.010375 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:21.010926 (+ 551us) server_negotiation.cc:299] Negotiation successful
0812 11:06:21.011082 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:06:21.012157 26504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:20.999245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45409 (local address 127.18.174.195:43093)
0812 11:06:20.999719 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:20.999764 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:21.001064 (+ 1300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:21.001720 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:21.001730 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:21.002189 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:21.002894 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:21.002915 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:21.003819 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:21.003822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:21.004812 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:21.004823 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:21.005327 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:21.005331 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:21.005515 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:21.006056 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:21.006074 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:21.007580 (+ 1506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:21.009231 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:21.009239 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:21.009259 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:21.009552 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:21.009830 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:21.009833 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:21.009835 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:21.009988 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:21.010387 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:21.010395 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:21.010680 (+ 285us) client_negotiation.cc:769] Sending connection context
0812 11:06:21.010865 (+ 185us) client_negotiation.cc:240] Negotiation successful
0812 11:06:21.011236 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":107,"threads_started":1}
I20260812 11:06:21.013314 26499 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45409
I20260812 11:06:21.013550 26499 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:21.014055 26499 heartbeater.cc:511] Master 127.18.174.254:45409 requested a full tablet report, sending...
I20260812 11:06:21.015169 25716 ts_manager.cc:194] Registered new tserver with Master: 4d68c871375a448aadb8e5004b75d114 (127.18.174.195:34485)
I20260812 11:06:21.015616 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:06:21.015789 25716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:43093
Aug 12 11:06:21 dist-test-slave-lgr5 krb5kdc[25625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532781, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:06:21 dist-test-slave-lgr5 krb5kdc[25625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532781, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.193@KRBTEST.COM
I20260812 11:06:21.042533 26514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:21.033187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56522 (local address 127.18.174.193:42135)
0812 11:06:21.033468 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:21.033492 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:21.033518 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:06:21.033592 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:21.033598 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:21.033798 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:21.033920 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:21.034607 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:21.035402 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:21.036291 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:21.036702 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:21.036791 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:21.039089 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:21.039101 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:21.039118 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:21.039149 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:21.040644 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:21.041100 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:21.041106 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:21.041107 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:21.041195 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:21.041442 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:21.041444 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:21.041445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:21.041737 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:21.041938 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:21.042147 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 11:06:21.042312 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":73,"threads_started":1}
Aug 12 11:06:21 dist-test-slave-lgr5 krb5kdc[25625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532781, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:21.053030 25786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:21.045448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47622 (local address 127.18.174.254:45409)
0812 11:06:21.045601 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:21.045605 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:21.045651 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:06:21.045764 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:21.045767 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:21.045811 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:21.045868 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:21.046403 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:21.046904 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:21.047612 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:21.047815 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:21.047881 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:21.050140 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:21.050145 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:21.050147 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:21.050175 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:21.051340 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:21.051763 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:21.051767 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:21.051769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:21.051859 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:21.052131 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:21.052135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:21.052137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:21.052376 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:21.052500 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:21.052744 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 11:06:21.052866 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260812 11:06:21.053457 25716 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47622
I20260812 11:06:21.054085 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 25824
I20260812 11:06:21.069610 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 26055
I20260812 11:06:21.084268 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 26276
I20260812 11:06:21.097117 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 25653
2026-08-12T11:06:21Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2436 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:06:21 dist-test-slave-lgr5 krb5kdc[26524](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:06:21 dist-test-slave-lgr5 krb5kdc[26524](info): set up 2 sockets
Aug 12 11:06:21 dist-test-slave-lgr5 krb5kdc[26524](info): commencing operation
krb5kdc: starting...
W20260812 11:06:22.342164 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260812 11:06:22.748064 19131 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.406s user 0.001s sys 0.001s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260812 11:06:22.922149 19131 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.174s user 0.002s sys 0.000s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:06:23 dist-test-slave-lgr5 krb5kdc[26524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532783, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:06:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:06:23.066849 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:46599
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:34573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:46599
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:23.184890 26545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:23.185182 26545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:23.185225 26545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:23.189347 26545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:23.189430 26545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:23.189450 26545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:23.189466 26545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:23.189483 26545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:23.195151 26545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:34573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:46599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:46599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:23.196358 26545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:23.197465 26545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:06:23.206359 26545 server_base.cc:1034] running on GCE node
W20260812 11:06:23.206321 26556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:23.206310 26554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:23.206285 26558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:23.207190 26545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:23.208465 26545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:23.209676 26545 hybrid_clock.cc:648] HybridClock initialized: now 1786532783209648 us; error 40 us; skew 500 ppm
Aug 12 11:06:23 dist-test-slave-lgr5 krb5kdc[26524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532783, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:23.216066 26545 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:06:23.216953 26545 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:23.217029 26545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:23.217212 26545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:23.219410 26545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "061d637295a34f2fb9a1a529c5011e9e"
format_stamp: "Formatted at 2026-08-12 11:06:23 on dist-test-slave-lgr5"
server_key: "3faba320bfe4e4a8c4947e4841dd4f6a"
server_key_iv: "acfd7460a1d8c666a185ebc7f01de030"
server_key_version: "encryptionkey@0"
I20260812 11:06:23.219981 26545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "061d637295a34f2fb9a1a529c5011e9e"
format_stamp: "Formatted at 2026-08-12 11:06:23 on dist-test-slave-lgr5"
server_key: "3faba320bfe4e4a8c4947e4841dd4f6a"
server_key_iv: "acfd7460a1d8c666a185ebc7f01de030"
server_key_version: "encryptionkey@0"
I20260812 11:06:23.224050 26545 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.002s
I20260812 11:06:23.226594 26564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:23.227882 26545 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:06:23.228015 26545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "061d637295a34f2fb9a1a529c5011e9e"
format_stamp: "Formatted at 2026-08-12 11:06:23 on dist-test-slave-lgr5"
server_key: "3faba320bfe4e4a8c4947e4841dd4f6a"
server_key_iv: "acfd7460a1d8c666a185ebc7f01de030"
server_key_version: "encryptionkey@0"
I20260812 11:06:23.228173 26545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:23.250015 26545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:23.253078 26545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:23.253273 26545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:23.260438 26545 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:46599
I20260812 11:06:23.260689 26656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:46599 every 8 connection(s)
I20260812 11:06:23.261157 26545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:23.264410 26658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:23.264734 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 26545
I20260812 11:06:23.264848 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:23.265100 19131 external_mini_cluster.cc:1428] Setting key 1581890a95cece82eebe54626bf76540
I20260812 11:06:23.271718 26658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e: Bootstrap starting.
Aug 12 11:06:23 dist-test-slave-lgr5 krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532783, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:23.274683 26658 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:23.275594 26658 log.cc:824] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:23.277936 26658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e: No bootstrap required, opened a new log
I20260812 11:06:23.279898 26664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:23.266566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38594 (local address 127.18.174.254:46599)
0812 11:06:23.267003 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:23.267021 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:23.267059 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:06:23.267764 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:23.267783 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:23.268195 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:23.268515 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:23.269442 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:23.270461 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:23.271667 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:23.272239 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:23.272366 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:23.275193 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:23.275198 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:23.275215 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:23.275249 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:23.276918 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:23.277425 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:23.277429 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:23.277434 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:23.277574 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:23.277872 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:23.277874 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:23.277875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:23.278320 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:23.278464 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:23.278798 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 11:06:23.279099 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":131,"threads_started":1}
I20260812 11:06:23.282131 26658 raft_consensus.cc:348] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061d637295a34f2fb9a1a529c5011e9e" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46599 } }
I20260812 11:06:23.282433 26658 raft_consensus.cc:374] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:23.282502 26658 raft_consensus.cc:729] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 061d637295a34f2fb9a1a529c5011e9e, State: Initialized, Role: FOLLOWER
I20260812 11:06:23.282965 26658 consensus_queue.cc:260] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061d637295a34f2fb9a1a529c5011e9e" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46599 } }
I20260812 11:06:23.283121 26658 raft_consensus.cc:388] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:23.283171 26658 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:23.283249 26658 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:23.284437 26658 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061d637295a34f2fb9a1a529c5011e9e" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46599 } }
I20260812 11:06:23.284852 26658 leader_election.cc:302] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 061d637295a34f2fb9a1a529c5011e9e; no voters:
I20260812 11:06:23.285198 26658 leader_election.cc:288] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:23.285367 26666 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:23.285599 26666 raft_consensus.cc:686] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [term 1 LEADER]: Becoming Leader. State: Replica: 061d637295a34f2fb9a1a529c5011e9e, State: Running, Role: LEADER
I20260812 11:06:23.285925 26666 consensus_queue.cc:237] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061d637295a34f2fb9a1a529c5011e9e" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46599 } }
I20260812 11:06:23.286525 26658 sys_catalog.cc:564] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:23.287600 26669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 061d637295a34f2fb9a1a529c5011e9e. Latest consensus state: current_term: 1 leader_uuid: "061d637295a34f2fb9a1a529c5011e9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061d637295a34f2fb9a1a529c5011e9e" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46599 } } }
I20260812 11:06:23.287740 26669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:23.288125 26668 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "061d637295a34f2fb9a1a529c5011e9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061d637295a34f2fb9a1a529c5011e9e" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46599 } } }
I20260812 11:06:23.288271 26668 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:23.288188 26685 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:23.291411 26685 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:23.297744 26685 catalog_manager.cc:1347] Generated new cluster ID: c134902a5a1c4e02ac6153637f497979
I20260812 11:06:23.297828 26685 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:23.317646 26685 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:23.318701 26685 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:23.325246 26685 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e: Generated new TSK 0
I20260812 11:06:23.325994 26685 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:06:23.365351 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46599
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:34573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:23.492570 26708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:23.492853 26708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:23.492919 26708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:23.497025 26708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:23.497092 26708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:23.497174 26708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:23.502574 26708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:34573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:23.503662 26708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:23.504763 26708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:23.514470 26722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:23.514518 26720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:23.514583 26708 server_base.cc:1034] running on GCE node
W20260812 11:06:23.514480 26718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:23.515175 26708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:23.515870 26708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:23.517045 26708 hybrid_clock.cc:648] HybridClock initialized: now 1786532783517001 us; error 56 us; skew 500 ppm
Aug 12 11:06:23 dist-test-slave-lgr5 krb5kdc[26524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532783, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:23.520244 26708 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:06:23.521023 26708 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:23.521087 26708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:23.521298 26708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:23.523572 26708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "5188810ecac14cef8877464d4968484d"
format_stamp: "Formatted at 2026-08-12 11:06:23 on dist-test-slave-lgr5"
server_key: "04b18fb4f344e2e35c0babb375d7e4b6"
server_key_iv: "82b626fd117e4504b43af55bb64dfa1e"
server_key_version: "encryptionkey@0"
I20260812 11:06:23.524210 26708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "5188810ecac14cef8877464d4968484d"
format_stamp: "Formatted at 2026-08-12 11:06:23 on dist-test-slave-lgr5"
server_key: "04b18fb4f344e2e35c0babb375d7e4b6"
server_key_iv: "82b626fd117e4504b43af55bb64dfa1e"
server_key_version: "encryptionkey@0"
I20260812 11:06:23.528384 26708 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:06:23.530951 26732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:23.532519 26708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:23.532655 26708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "5188810ecac14cef8877464d4968484d"
format_stamp: "Formatted at 2026-08-12 11:06:23 on dist-test-slave-lgr5"
server_key: "04b18fb4f344e2e35c0babb375d7e4b6"
server_key_iv: "82b626fd117e4504b43af55bb64dfa1e"
server_key_version: "encryptionkey@0"
I20260812 11:06:23.532779 26708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:23.554522 26708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:23.557701 26708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:23.557898 26708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:23.558488 26708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:23.559412 26708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:23.559466 26708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:23.559514 26708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:23.559540 26708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:23.568929 26708 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:39943
I20260812 11:06:23.568972 26922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:39943 every 8 connection(s)
I20260812 11:06:23.569607 26708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:06:23.573892 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 26708
I20260812 11:06:23.574015 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:06:23.574335 19131 external_mini_cluster.cc:1428] Setting key 2e9ba59ed96ec8c9762181995ffdce9c
Aug 12 11:06:23 dist-test-slave-lgr5 krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532783, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:23.583745 26664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:23.571516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:44421 (local address 127.18.174.254:46599)
0812 11:06:23.571671 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:23.571677 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:23.572623 (+ 946us) server_negotiation.cc:407] Connection header received
0812 11:06:23.573949 (+ 1326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:23.573953 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:23.574028 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:23.574112 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:23.575523 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:23.576204 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:23.577359 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:23.577651 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:23.577755 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:23.580330 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:23.580333 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:23.580335 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:23.580362 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:23.581707 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:23.582216 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:23.582219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:23.582221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:23.582299 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:23.582622 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:23.582625 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:23.582627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:23.582814 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:23.582901 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:23.583418 (+ 517us) server_negotiation.cc:299] Negotiation successful
0812 11:06:23.583571 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
I20260812 11:06:23.584726 26925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:23.571920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46599 (local address 127.18.174.193:44421)
0812 11:06:23.572441 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:23.572507 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:23.573707 (+ 1200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:23.574331 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:23.574339 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:23.574783 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:23.575365 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:23.575381 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:23.576326 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:23.576329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:23.577232 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:23.577243 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:23.577815 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:23.577818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:23.577996 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:23.578624 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:23.578641 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:23.580160 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:23.581821 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:23.581828 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:23.581845 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:23.582121 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:23.582383 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:23.582386 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:23.582388 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:23.582535 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:23.582913 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:23.582920 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:23.583186 (+ 266us) client_negotiation.cc:769] Sending connection context
0812 11:06:23.583359 (+ 173us) client_negotiation.cc:240] Negotiation successful
0812 11:06:23.583704 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":165,"threads_started":1}
I20260812 11:06:23.586018 26923 heartbeater.cc:347] Connected to a master server at 127.18.174.254:46599
I20260812 11:06:23.586297 26923 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
I20260812 11:06:23.586845 26923 heartbeater.cc:511] Master 127.18.174.254:46599 requested a full tablet report, sending...
I20260812 11:06:23.588667 26595 ts_manager.cc:194] Registered new tserver with Master: 5188810ecac14cef8877464d4968484d (127.18.174.193:39943)
I20260812 11:06:23.590199 26595 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:44421
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:06:23.604414 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46599
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:34573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:23.719861 26929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:23.720161 26929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:23.720209 26929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:23.724228 26929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:23.724300 26929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:23.724385 26929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:06:23.729794 26929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:34573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:23.730928 26929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:23.732110 26929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:23.742241 26941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:23.742233 26945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:23.742398 26942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:23.742512 26929 server_base.cc:1034] running on GCE node
I20260812 11:06:23.743041 26929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:23.743722 26929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:23.744879 26929 hybrid_clock.cc:648] HybridClock initialized: now 1786532783744849 us; error 50 us; skew 500 ppm
Aug 12 11:06:23 dist-test-slave-lgr5 krb5kdc[26524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532783, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:23.747728 26929 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:06:23.748560 26929 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:23.748636 26929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:23.748839 26929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:23.751003 26929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "43f94f697cec473094ffb75afc48274a"
format_stamp: "Formatted at 2026-08-12 11:06:23 on dist-test-slave-lgr5"
server_key: "6edc387e6ead9fd7a6d30862e8230b2d"
server_key_iv: "4b537ddd16c921547da62e070a50f9ec"
server_key_version: "encryptionkey@0"
I20260812 11:06:23.751564 26929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "43f94f697cec473094ffb75afc48274a"
format_stamp: "Formatted at 2026-08-12 11:06:23 on dist-test-slave-lgr5"
server_key: "6edc387e6ead9fd7a6d30862e8230b2d"
server_key_iv: "4b537ddd16c921547da62e070a50f9ec"
server_key_version: "encryptionkey@0"
I20260812 11:06:23.755501 26929 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:06:23.758147 26959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:23.759495 26929 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:23.759631 26929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "43f94f697cec473094ffb75afc48274a"
format_stamp: "Formatted at 2026-08-12 11:06:23 on dist-test-slave-lgr5"
server_key: "6edc387e6ead9fd7a6d30862e8230b2d"
server_key_iv: "4b537ddd16c921547da62e070a50f9ec"
server_key_version: "encryptionkey@0"
I20260812 11:06:23.759744 26929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:23.769521 26929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:23.773008 26929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:23.773206 26929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:23.773845 26929 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:23.774760 26929 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:23.774812 26929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:23.774875 26929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:23.774902 26929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:23.784155 26929 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:41991
I20260812 11:06:23.784183 27168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:41991 every 8 connection(s)
I20260812 11:06:23.784790 26929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:06:23.791158 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 26929
I20260812 11:06:23.791290 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:06:23.791632 19131 external_mini_cluster.cc:1428] Setting key 44f612544487b5fd8cf92248c2092107
Aug 12 11:06:23 dist-test-slave-lgr5 krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532783, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:23.799772 26664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:23.786583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:37413 (local address 127.18.174.254:46599)
0812 11:06:23.786723 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:23.786729 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:23.787708 (+ 979us) server_negotiation.cc:407] Connection header received
0812 11:06:23.789179 (+ 1471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:23.789182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:23.789232 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:23.789298 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:23.790539 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:23.791072 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:23.792716 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:23.793015 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:23.793129 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:23.796072 (+ 2943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:23.796076 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:23.796096 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:23.796132 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:23.797497 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:23.797996 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:23.798000 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:23.798001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:23.798079 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:23.798467 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:23.798472 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:23.798475 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:23.798769 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:23.798894 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:23.799419 (+ 525us) server_negotiation.cc:299] Negotiation successful
0812 11:06:23.799563 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:06:23.800537 27177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:23.787022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46599 (local address 127.18.174.194:37413)
0812 11:06:23.787547 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:23.787602 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:23.788921 (+ 1319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:23.789460 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:23.789467 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:23.789879 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:23.790403 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:23.790417 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:23.791216 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:23.791220 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:23.792587 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:23.792599 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:23.793179 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:23.793184 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:23.793385 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:23.794014 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:23.794037 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:23.795874 (+ 1837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:23.797617 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:23.797623 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:23.797638 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:23.797890 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:23.798166 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:23.798168 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:23.798170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:23.798319 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:23.798891 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:23.798896 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:23.799158 (+ 262us) client_negotiation.cc:769] Sending connection context
0812 11:06:23.799322 (+ 164us) client_negotiation.cc:240] Negotiation successful
0812 11:06:23.799604 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":123,"threads_started":1}
I20260812 11:06:23.801800 27171 heartbeater.cc:347] Connected to a master server at 127.18.174.254:46599
I20260812 11:06:23.802103 27171 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:23.802711 27171 heartbeater.cc:511] Master 127.18.174.254:46599 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
I20260812 11:06:23.803936 26595 ts_manager.cc:194] Registered new tserver with Master: 43f94f697cec473094ffb75afc48274a (127.18.174.194:41991)
I20260812 11:06:23.804554 26595 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:37413
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:06:23.822960 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46599
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:34573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:23.942842 27180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:23.943149 27180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:23.943198 27180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:23.947372 27180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:23.947461 27180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:23.947527 27180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:06:23.953233 27180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:34573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:23.954382 27180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:23.955490 27180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:23.965514 27193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:23.965517 27189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:23.965517 27187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:23.965914 27180 server_base.cc:1034] running on GCE node
I20260812 11:06:23.966374 27180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:23.967013 27180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:23.968149 27180 hybrid_clock.cc:648] HybridClock initialized: now 1786532783968127 us; error 41 us; skew 500 ppm
Aug 12 11:06:23 dist-test-slave-lgr5 krb5kdc[26524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532783, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:23.971052 27180 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:06:23.972025 27180 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:23.972152 27180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:23.972414 27180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:23.975436 27180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "4c872dd0e9974b9da11afd4f5d4d6857"
format_stamp: "Formatted at 2026-08-12 11:06:23 on dist-test-slave-lgr5"
server_key: "475d656ff9a6f9723cd33e54033fe907"
server_key_iv: "e4d64d518f9a4e0ca00780064c5d9580"
server_key_version: "encryptionkey@0"
I20260812 11:06:23.976202 27180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "4c872dd0e9974b9da11afd4f5d4d6857"
format_stamp: "Formatted at 2026-08-12 11:06:23 on dist-test-slave-lgr5"
server_key: "475d656ff9a6f9723cd33e54033fe907"
server_key_iv: "e4d64d518f9a4e0ca00780064c5d9580"
server_key_version: "encryptionkey@0"
I20260812 11:06:23.981392 27180 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 11:06:23.984004 27204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:23.985399 27180 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:06:23.985560 27180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "4c872dd0e9974b9da11afd4f5d4d6857"
format_stamp: "Formatted at 2026-08-12 11:06:23 on dist-test-slave-lgr5"
server_key: "475d656ff9a6f9723cd33e54033fe907"
server_key_iv: "e4d64d518f9a4e0ca00780064c5d9580"
server_key_version: "encryptionkey@0"
I20260812 11:06:23.985677 27180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:23.997054 27180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:23.999931 27180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:24.000157 27180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:24.000780 27180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:24.001724 27180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:24.001778 27180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:24.001835 27180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:24.001860 27180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:24.010835 27180 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:45773
I20260812 11:06:24.010854 27409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:45773 every 8 connection(s)
I20260812 11:06:24.011493 27180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:06:24.020684 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 27180
I20260812 11:06:24.020805 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
Aug 12 11:06:24 dist-test-slave-lgr5 krb5kdc[26524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532783, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:24.021106 19131 external_mini_cluster.cc:1428] Setting key 6d774f45d38cd35816f9147e2915c32d
I20260812 11:06:24.025520 26664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.013400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:38989 (local address 127.18.174.254:46599)
0812 11:06:24.013565 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:24.013569 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:24.014815 (+ 1246us) server_negotiation.cc:407] Connection header received
0812 11:06:24.015726 (+ 911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:24.015728 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:24.015777 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:24.015840 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:24.017093 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.017619 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.018717 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.018919 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.018996 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:24.021601 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:24.021605 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:24.021607 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:24.021635 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:24.023262 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:24.023942 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:24.023946 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:24.023947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:24.024037 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:24.024420 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:24.024422 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:24.024423 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:24.024632 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:24.024710 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:24.025256 (+ 546us) server_negotiation.cc:299] Negotiation successful
0812 11:06:24.025375 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:06:24.026432 27412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.013807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46599 (local address 127.18.174.195:38989)
0812 11:06:24.014655 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:24.014701 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:24.015522 (+ 821us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:24.016008 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:24.016015 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:24.016415 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:24.016952 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:24.016967 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.017715 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.017718 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:24.018624 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:24.018634 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.019034 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.019036 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:24.019194 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:24.019752 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:24.019769 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:24.021400 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:24.023423 (+ 2023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:24.023430 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:24.023450 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:24.023848 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:24.024182 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:24.024184 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:24.024186 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:24.024341 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:24.024735 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:24.024741 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:24.025047 (+ 306us) client_negotiation.cc:769] Sending connection context
0812 11:06:24.025224 (+ 177us) client_negotiation.cc:240] Negotiation successful
0812 11:06:24.025534 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":138,"threads_started":1}
I20260812 11:06:24.027581 27410 heartbeater.cc:347] Connected to a master server at 127.18.174.254:46599
I20260812 11:06:24.027822 27410 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:24.028337 27410 heartbeater.cc:511] Master 127.18.174.254:46599 requested a full tablet report, sending...
I20260812 11:06:24.029387 26595 ts_manager.cc:194] Registered new tserver with Master: 4c872dd0e9974b9da11afd4f5d4d6857 (127.18.174.195:45773)
I20260812 11:06:24.029975 26595 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:38989
I20260812 11:06:24.035332 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:06:24.044397 26664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.037374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38598 (local address 127.18.174.254:46599)
0812 11:06:24.037521 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:24.037526 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:24.037694 (+ 168us) server_negotiation.cc:407] Connection header received
0812 11:06:24.037836 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:24.037838 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:24.037880 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:24.037944 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:24.038651 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.039166 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.039987 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.040251 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.040344 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:24.041621 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:24.041625 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:24.041628 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:24.041656 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:24.042699 (+ 1043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:24.043118 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:24.043122 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:24.043124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:24.043206 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:24.043460 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:24.043463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:24.043465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:24.043710 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:24.043839 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:24.044123 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 11:06:24.044243 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:06:24.047223 26595 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38598:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:06:24.050521 26595 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:24.065970 27433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.059711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47220 (local address 127.18.174.195:45773)
0812 11:06:24.060637 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:24.060648 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:24.060666 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:06:24.060744 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:24.060748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:24.060965 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:24.061484 (+ 519us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:24.061641 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.062750 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.064315 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.065198 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.065333 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:24.065497 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:24.065681 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 11:06:24.065802 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":835,"thread_start_us":155,"threads_started":1}
I20260812 11:06:24.065949 27427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.059576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45773 (local address 127.0.0.1:47220)
0812 11:06:24.060029 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:24.060113 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:24.060255 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:24.061153 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:24.061159 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:24.061185 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:24.061322 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:24.061328 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.062893 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.062897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:24.064192 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:24.064199 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.065336 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.065340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:24.065458 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:24.065497 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 11:06:24.065624 (+ 127us) client_negotiation.cc:240] Negotiation successful
0812 11:06:24.065770 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":11,"thread_start_us":101,"threads_started":1}
I20260812 11:06:24.066293 27437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.060168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34266 (local address 127.18.174.194:41991)
0812 11:06:24.060619 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:24.060632 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:24.060660 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:06:24.060743 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:24.060748 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:24.060965 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:24.061136 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:24.061513 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.062447 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.064313 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.065198 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.065333 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:24.065486 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:24.066038 (+ 552us) server_negotiation.cc:299] Negotiation successful
0812 11:06:24.066154 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":110,"threads_started":1}
I20260812 11:06:24.066485 27442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.060906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35116 (local address 127.18.174.193:39943)
0812 11:06:24.061282 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:24.061289 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:24.061596 (+ 307us) server_negotiation.cc:407] Connection header received
0812 11:06:24.061699 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:24.061705 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:24.061916 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:24.062073 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:24.062291 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.063283 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.064673 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.065234 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.065353 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:24.065505 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:24.066022 (+ 517us) server_negotiation.cc:299] Negotiation successful
0812 11:06:24.066328 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":91,"threads_started":1}
I20260812 11:06:24.066538 27429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.059693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:41991 (local address 127.0.0.1:34266)
0812 11:06:24.060494 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:24.060508 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:24.060590 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:24.061309 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:24.061313 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:24.061328 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:24.061408 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:24.061414 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.062586 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.062589 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:24.064158 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:24.064171 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.065585 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.065588 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:24.065740 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:24.065764 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:06:24.065834 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 11:06:24.065907 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":736,"mutex_wait_us":107,"thread_start_us":121,"threads_started":1}
I20260812 11:06:24.065949 27440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.060627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:39943 (local address 127.0.0.1:35116)
0812 11:06:24.061466 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:24.061491 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:24.061592 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:24.062065 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:24.062069 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:24.062088 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:24.062174 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:24.062179 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.063416 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.063419 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:24.064551 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:24.064562 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.065569 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.065573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:24.065704 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:24.065727 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:06:24.065787 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 11:06:24.065840 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":777,"mutex_wait_us":28,"thread_start_us":96,"threads_started":1}
I20260812 11:06:24.069509 27051 tablet_service.cc:1467] Processing CreateTablet for tablet 2b0a2a5ba74b4e04a2c2c840cf25766b (DEFAULT_TABLE table=test-table [id=928d5ccbd65044f69b9c06edd41c86a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:24.069590 26810 tablet_service.cc:1467] Processing CreateTablet for tablet 2b0a2a5ba74b4e04a2c2c840cf25766b (DEFAULT_TABLE table=test-table [id=928d5ccbd65044f69b9c06edd41c86a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:24.070555 27051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b0a2a5ba74b4e04a2c2c840cf25766b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:24.070564 26810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b0a2a5ba74b4e04a2c2c840cf25766b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:24.072973 27290 tablet_service.cc:1467] Processing CreateTablet for tablet 2b0a2a5ba74b4e04a2c2c840cf25766b (DEFAULT_TABLE table=test-table [id=928d5ccbd65044f69b9c06edd41c86a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:24.074167 27290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b0a2a5ba74b4e04a2c2c840cf25766b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:24.077248 27443 tablet_bootstrap.cc:492] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a: Bootstrap starting.
I20260812 11:06:24.079025 27446 tablet_bootstrap.cc:492] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d: Bootstrap starting.
I20260812 11:06:24.079502 27443 tablet_bootstrap.cc:654] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:24.080632 27443 log.cc:824] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:24.081374 27446 tablet_bootstrap.cc:654] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:24.081498 27448 tablet_bootstrap.cc:492] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857: Bootstrap starting.
I20260812 11:06:24.082630 27446 log.cc:824] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:24.082964 27443 tablet_bootstrap.cc:492] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a: No bootstrap required, opened a new log
I20260812 11:06:24.083187 27443 ts_tablet_manager.cc:1397] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260812 11:06:24.084218 27448 tablet_bootstrap.cc:654] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:24.084461 27446 tablet_bootstrap.cc:492] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d: No bootstrap required, opened a new log
I20260812 11:06:24.084643 27446 ts_tablet_manager.cc:1397] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:06:24.085410 27448 log.cc:824] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:24.087213 27443 raft_consensus.cc:348] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c872dd0e9974b9da11afd4f5d4d6857" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45773 } } peers { permanent_uuid: "43f94f697cec473094ffb75afc48274a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41991 } } peers { permanent_uuid: "5188810ecac14cef8877464d4968484d" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 39943 } }
I20260812 11:06:24.087554 27443 raft_consensus.cc:374] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:24.087620 27443 raft_consensus.cc:729] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43f94f697cec473094ffb75afc48274a, State: Initialized, Role: FOLLOWER
I20260812 11:06:24.087746 27448 tablet_bootstrap.cc:492] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857: No bootstrap required, opened a new log
I20260812 11:06:24.087939 27448 ts_tablet_manager.cc:1397] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260812 11:06:24.087783 27446 raft_consensus.cc:348] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c872dd0e9974b9da11afd4f5d4d6857" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45773 } } peers { permanent_uuid: "43f94f697cec473094ffb75afc48274a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41991 } } peers { permanent_uuid: "5188810ecac14cef8877464d4968484d" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 39943 } }
I20260812 11:06:24.088013 27446 raft_consensus.cc:374] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:24.088097 27446 raft_consensus.cc:729] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5188810ecac14cef8877464d4968484d, State: Initialized, Role: FOLLOWER
I20260812 11:06:24.088194 27443 consensus_queue.cc:260] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c872dd0e9974b9da11afd4f5d4d6857" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45773 } } peers { permanent_uuid: "43f94f697cec473094ffb75afc48274a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41991 } } peers { permanent_uuid: "5188810ecac14cef8877464d4968484d" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 39943 } }
I20260812 11:06:24.088536 27446 consensus_queue.cc:260] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c872dd0e9974b9da11afd4f5d4d6857" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45773 } } peers { permanent_uuid: "43f94f697cec473094ffb75afc48274a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41991 } } peers { permanent_uuid: "5188810ecac14cef8877464d4968484d" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 39943 } }
I20260812 11:06:24.089277 27443 ts_tablet_manager.cc:1428] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:06:24.089514 27446 ts_tablet_manager.cc:1428] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
I20260812 11:06:24.089701 27171 heartbeater.cc:503] Master 127.18.174.254:46599 was elected leader, sending a full tablet report...
I20260812 11:06:24.089850 26923 heartbeater.cc:503] Master 127.18.174.254:46599 was elected leader, sending a full tablet report...
I20260812 11:06:24.092921 27448 raft_consensus.cc:348] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c872dd0e9974b9da11afd4f5d4d6857" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45773 } } peers { permanent_uuid: "43f94f697cec473094ffb75afc48274a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41991 } } peers { permanent_uuid: "5188810ecac14cef8877464d4968484d" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 39943 } }
I20260812 11:06:24.093242 27448 raft_consensus.cc:374] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:24.093322 27448 raft_consensus.cc:729] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c872dd0e9974b9da11afd4f5d4d6857, State: Initialized, Role: FOLLOWER
I20260812 11:06:24.093852 27448 consensus_queue.cc:260] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c872dd0e9974b9da11afd4f5d4d6857" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45773 } } peers { permanent_uuid: "43f94f697cec473094ffb75afc48274a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41991 } } peers { permanent_uuid: "5188810ecac14cef8877464d4968484d" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 39943 } }
I20260812 11:06:24.094605 27410 heartbeater.cc:503] Master 127.18.174.254:46599 was elected leader, sending a full tablet report...
I20260812 11:06:24.095045 27448 ts_tablet_manager.cc:1428] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260812 11:06:24.201305 27458 raft_consensus.cc:482] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:24.201562 27458 raft_consensus.cc:504] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c872dd0e9974b9da11afd4f5d4d6857" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45773 } } peers { permanent_uuid: "43f94f697cec473094ffb75afc48274a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41991 } } peers { permanent_uuid: "5188810ecac14cef8877464d4968484d" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 39943 } }
I20260812 11:06:24.202817 27458 leader_election.cc:288] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43f94f697cec473094ffb75afc48274a (127.18.174.194:41991), 5188810ecac14cef8877464d4968484d (127.18.174.193:39943)
I20260812 11:06:24.207409 27412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.203134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:41991 (local address 127.18.174.195:33871)
0812 11:06:24.203260 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:24.203275 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:24.203386 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:24.203797 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:24.203805 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:24.203834 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:24.203973 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:24.203981 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.204930 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.204933 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:24.206126 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:24.206138 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.206988 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.206991 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:24.207088 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:24.207111 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:06:24.207171 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 11:06:24.207254 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 11:06:24.207420 27437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.203261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:33871 (local address 127.18.174.194:41991)
0812 11:06:24.203401 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:24.203407 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:24.203493 (+ 86us) server_negotiation.cc:407] Connection header received
0812 11:06:24.203561 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:24.203564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:24.203618 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:24.203696 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:24.204112 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.204810 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.206286 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.206857 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.206988 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:24.207047 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:24.207220 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 11:06:24.207304 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:06:24.207623 27460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.203427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:39943 (local address 127.18.174.195:57579)
0812 11:06:24.203883 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:24.203901 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:24.204013 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:24.204316 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:24.204321 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:24.204347 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:24.204461 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:24.204467 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.205289 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.205292 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:24.206409 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:24.206417 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.207241 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.207244 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:24.207335 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:24.207356 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 11:06:24.207427 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 11:06:24.207491 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":131,"threads_started":1}
I20260812 11:06:24.207643 27442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.203611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:57579 (local address 127.18.174.193:39943)
0812 11:06:24.203743 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:24.203747 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:24.203991 (+ 244us) server_negotiation.cc:407] Connection header received
0812 11:06:24.204121 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:24.204124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:24.204172 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:24.204253 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:24.204583 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.205170 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.206535 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.207127 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.207240 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:24.207286 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:24.207455 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 11:06:24.207532 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:06:24.208312 27083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0a2a5ba74b4e04a2c2c840cf25766b" candidate_uuid: "4c872dd0e9974b9da11afd4f5d4d6857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f94f697cec473094ffb75afc48274a" is_pre_election: true
I20260812 11:06:24.208313 26844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0a2a5ba74b4e04a2c2c840cf25766b" candidate_uuid: "4c872dd0e9974b9da11afd4f5d4d6857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5188810ecac14cef8877464d4968484d" is_pre_election: true
I20260812 11:06:24.208636 26844 raft_consensus.cc:2454] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c872dd0e9974b9da11afd4f5d4d6857 in term 0.
I20260812 11:06:24.208654 27083 raft_consensus.cc:2454] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c872dd0e9974b9da11afd4f5d4d6857 in term 0.
I20260812 11:06:24.209112 27207 leader_election.cc:302] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f94f697cec473094ffb75afc48274a, 4c872dd0e9974b9da11afd4f5d4d6857; no voters:
I20260812 11:06:24.209409 27458 raft_consensus.cc:2781] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:24.209506 27458 raft_consensus.cc:482] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:24.209538 27458 raft_consensus.cc:3037] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:24.210623 27458 raft_consensus.cc:504] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c872dd0e9974b9da11afd4f5d4d6857" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45773 } } peers { permanent_uuid: "43f94f697cec473094ffb75afc48274a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41991 } } peers { permanent_uuid: "5188810ecac14cef8877464d4968484d" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 39943 } }
I20260812 11:06:24.210979 27458 leader_election.cc:288] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [CANDIDATE]: Term 1 election: Requested vote from peers 43f94f697cec473094ffb75afc48274a (127.18.174.194:41991), 5188810ecac14cef8877464d4968484d (127.18.174.193:39943)
I20260812 11:06:24.211419 27083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0a2a5ba74b4e04a2c2c840cf25766b" candidate_uuid: "4c872dd0e9974b9da11afd4f5d4d6857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f94f697cec473094ffb75afc48274a"
I20260812 11:06:24.211406 26844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0a2a5ba74b4e04a2c2c840cf25766b" candidate_uuid: "4c872dd0e9974b9da11afd4f5d4d6857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5188810ecac14cef8877464d4968484d"
I20260812 11:06:24.211548 26844 raft_consensus.cc:3037] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:24.211548 27083 raft_consensus.cc:3037] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:24.212947 26844 raft_consensus.cc:2454] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c872dd0e9974b9da11afd4f5d4d6857 in term 1.
I20260812 11:06:24.212947 27083 raft_consensus.cc:2454] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c872dd0e9974b9da11afd4f5d4d6857 in term 1.
I20260812 11:06:24.213325 27207 leader_election.cc:302] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43f94f697cec473094ffb75afc48274a, 4c872dd0e9974b9da11afd4f5d4d6857; no voters:
I20260812 11:06:24.213526 27458 raft_consensus.cc:2781] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:24.213789 27458 raft_consensus.cc:686] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [term 1 LEADER]: Becoming Leader. State: Replica: 4c872dd0e9974b9da11afd4f5d4d6857, State: Running, Role: LEADER
I20260812 11:06:24.214159 27458 consensus_queue.cc:237] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c872dd0e9974b9da11afd4f5d4d6857" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45773 } } peers { permanent_uuid: "43f94f697cec473094ffb75afc48274a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41991 } } peers { permanent_uuid: "5188810ecac14cef8877464d4968484d" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 39943 } }
I20260812 11:06:24.217543 26595 catalog_manager.cc:5495] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c872dd0e9974b9da11afd4f5d4d6857 (127.18.174.195). New cstate: current_term: 1 leader_uuid: "4c872dd0e9974b9da11afd4f5d4d6857" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c872dd0e9974b9da11afd4f5d4d6857" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43f94f697cec473094ffb75afc48274a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5188810ecac14cef8877464d4968484d" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 39943 } health_report { overall_health: UNKNOWN } } }
I20260812 11:06:24.257054 27433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.253463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47230 (local address 127.18.174.195:45773)
0812 11:06:24.253597 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:24.253602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:24.253616 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:06:24.253740 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:24.253743 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:24.253803 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:24.253897 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:24.254166 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.254669 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.255535 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:24.255758 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:24.255849 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:24.256195 (+ 346us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:24.256636 (+ 441us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:24.256748 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:24.256817 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 11:06:24.256883 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260812 11:06:24.262391 27411 tablet.cc:2369] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:06:24.263655 26844 raft_consensus.cc:1261] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d [term 1 FOLLOWER]: Refusing update from remote peer 4c872dd0e9974b9da11afd4f5d4d6857: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:24.263665 27083 raft_consensus.cc:1261] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a [term 1 FOLLOWER]: Refusing update from remote peer 4c872dd0e9974b9da11afd4f5d4d6857: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:24.264405 27458 consensus_queue.cc:1035] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5188810ecac14cef8877464d4968484d" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:24.264684 27463 consensus_queue.cc:1035] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f94f697cec473094ffb75afc48274a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:24.275893 27469 mvcc.cc:205] Tried to move back new op lower bound from 7317638284335550464 to 7317638284144156672. Current Snapshot: MvccSnapshot[applied={T|T < 7317638284335550464}]
I20260812 11:06:24.279493 27470 mvcc.cc:205] Tried to move back new op lower bound from 7317638284335550464 to 7317638284144156672. Current Snapshot: MvccSnapshot[applied={T|T < 7317638284335550464}]
I20260812 11:06:24.281761 26593 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:24.281951 26593 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:24.284749 26593 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 061d637295a34f2fb9a1a529c5011e9e: Sending DeleteTablet for 3 replicas of tablet 2b0a2a5ba74b4e04a2c2c840cf25766b
I20260812 11:06:24.285676 27290 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0a2a5ba74b4e04a2c2c840cf25766b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:24 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:47220
I20260812 11:06:24.285861 26810 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0a2a5ba74b4e04a2c2c840cf25766b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:24 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:35116
I20260812 11:06:24.285892 27051 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0a2a5ba74b4e04a2c2c840cf25766b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:24 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:34266
I20260812 11:06:24.286309 27490 tablet_replica.cc:330] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d: stopping tablet replica
I20260812 11:06:24.286592 27493 tablet_replica.cc:330] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a: stopping tablet replica
I20260812 11:06:24.286696 27490 raft_consensus.cc:2229] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:24.287112 27490 raft_consensus.cc:2258] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 5188810ecac14cef8877464d4968484d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:24.287166 27485 tablet_replica.cc:330] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857: stopping tablet replica
I20260812 11:06:24.287398 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 26708
I20260812 11:06:24.287696 27485 raft_consensus.cc:2229] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:06:24.288204 27485 raft_consensus.cc:2258] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:24.292528 27485 ts_tablet_manager.cc:1905] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:24.295514 27485 ts_tablet_manager.cc:1918] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:24.295691 27485 log.cc:1196] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/2b0a2a5ba74b4e04a2c2c840cf25766b
I20260812 11:06:24.296051 27485 ts_tablet_manager.cc:1939] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 4c872dd0e9974b9da11afd4f5d4d6857: Deleting consensus metadata
I20260812 11:06:24.311064 27493 raft_consensus.cc:2229] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:24.311610 27493 raft_consensus.cc:2258] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:24.322309 27493 ts_tablet_manager.cc:1905] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:24.322342 26569 catalog_manager.cc:4841] TS 4c872dd0e9974b9da11afd4f5d4d6857 (127.18.174.195:45773): tablet 2b0a2a5ba74b4e04a2c2c840cf25766b (table test-table [id=928d5ccbd65044f69b9c06edd41c86a9]) successfully deleted
I20260812 11:06:24.325492 27493 ts_tablet_manager.cc:1918] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:24.325616 27493 log.cc:1196] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/2b0a2a5ba74b4e04a2c2c840cf25766b
I20260812 11:06:24.325924 27493 ts_tablet_manager.cc:1939] T 2b0a2a5ba74b4e04a2c2c840cf25766b P 43f94f697cec473094ffb75afc48274a: Deleting consensus metadata
I20260812 11:06:24.327356 26566 catalog_manager.cc:4841] TS 43f94f697cec473094ffb75afc48274a (127.18.174.194:41991): tablet 2b0a2a5ba74b4e04a2c2c840cf25766b (table test-table [id=928d5ccbd65044f69b9c06edd41c86a9]) successfully deleted
W20260812 11:06:24.328020 26566 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:39943 (error 108)
I20260812 11:06:24.328919 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 26929
I20260812 11:06:24.329236 27429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.328875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:39943 (local address 127.0.0.1:35128)
0812 11:06:24.329080 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:24.329149 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:39943: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260812 11:06:24.338040 26566 catalog_manager.cc:4584] TS 5188810ecac14cef8877464d4968484d (127.18.174.193:39943): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2b0a2a5ba74b4e04a2c2c840cf25766b: Network error: Client connection negotiation failed: client connection to 127.18.174.193:39943: connect: Connection refused (error 111)
I20260812 11:06:24.360453 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 27180
I20260812 11:06:24.380717 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 26545
2026-08-12T11:06:24Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (3288 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T11:06:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:24Z Disabled control of system clock
I20260812 11:06:24.426412 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:41295
--webserver_interface=127.18.174.254
--webserver_port=0
--builtin_ntp_servers=127.18.174.212:39243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:41295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 11:06:24.539950 27501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:24.540259 27501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:24.540297 27501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:24.544351 27501 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:24.544415 27501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:24.544430 27501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:24.544445 27501 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:24.544459 27501 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:24.549211 27501 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:41295
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:41295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27501
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:24.550314 27501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:24.551741 27501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:24.560446 27506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:24.560458 27514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:24.560550 27501 server_base.cc:1034] running on GCE node
W20260812 11:06:24.560451 27511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:24.561337 27501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:24.562556 27501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:24.563720 27501 hybrid_clock.cc:648] HybridClock initialized: now 1786532784563702 us; error 34 us; skew 500 ppm
I20260812 11:06:24.565698 27501 webserver.cc:460] Webserver started at http://127.18.174.254:33061/ using document root <none> and password file <none>
I20260812 11:06:24.566291 27501 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:24.566360 27501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:24.566592 27501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:24.568840 27501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "f43d1015e89546ae829d03718ba6cc9a"
format_stamp: "Formatted at 2026-08-12 11:06:24 on dist-test-slave-lgr5"
server_key: "076fad85cd736cab7d31c797ae70a5c5"
server_key_iv: "debfed1dfd93a93213fe4d576caff7d4"
server_key_version: "encryptionkey@0"
I20260812 11:06:24.569408 27501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "f43d1015e89546ae829d03718ba6cc9a"
format_stamp: "Formatted at 2026-08-12 11:06:24 on dist-test-slave-lgr5"
server_key: "076fad85cd736cab7d31c797ae70a5c5"
server_key_iv: "debfed1dfd93a93213fe4d576caff7d4"
server_key_version: "encryptionkey@0"
I20260812 11:06:24.573241 27501 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260812 11:06:24.575704 27523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:24.577023 27501 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:06:24.577155 27501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "f43d1015e89546ae829d03718ba6cc9a"
format_stamp: "Formatted at 2026-08-12 11:06:24 on dist-test-slave-lgr5"
server_key: "076fad85cd736cab7d31c797ae70a5c5"
server_key_iv: "debfed1dfd93a93213fe4d576caff7d4"
server_key_version: "encryptionkey@0"
I20260812 11:06:24.577265 27501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:24.581887 27501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:24.582499 27501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:24.582652 27501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:24.590236 27612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:41295 every 8 connection(s)
I20260812 11:06:24.590236 27501 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:41295
I20260812 11:06:24.591312 27501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:24.592425 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 27501
I20260812 11:06:24.592557 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:24.592854 19131 external_mini_cluster.cc:1428] Setting key 2d4587afe7594681571bedbd845a8fef
I20260812 11:06:24.595019 27614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:24.599329 27621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.594357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33752 (local address 127.18.174.254:41295)
0812 11:06:24.595709 (+ 1352us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:24.595725 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:24.595764 (+ 39us) server_negotiation.cc:407] Connection header received
0812 11:06:24.596485 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:24.596507 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:24.596877 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:24.597216 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:24.598036 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:24.598041 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:24.598054 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:24.598065 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:24.598124 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:24.598141 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:24.598275 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:24.598350 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 11:06:24.598601 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":970,"thread_start_us":802,"threads_started":1}
I20260812 11:06:24.601395 27614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a: Bootstrap starting.
I20260812 11:06:24.603610 27614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:24.604480 27614 log.cc:824] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:24.606899 27614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a: No bootstrap required, opened a new log
I20260812 11:06:24.610577 27614 raft_consensus.cc:348] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43d1015e89546ae829d03718ba6cc9a" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41295 } }
I20260812 11:06:24.610831 27614 raft_consensus.cc:374] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:24.610893 27614 raft_consensus.cc:729] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f43d1015e89546ae829d03718ba6cc9a, State: Initialized, Role: FOLLOWER
I20260812 11:06:24.611320 27614 consensus_queue.cc:260] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43d1015e89546ae829d03718ba6cc9a" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41295 } }
I20260812 11:06:24.611452 27614 raft_consensus.cc:388] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:24.611528 27614 raft_consensus.cc:482] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:24.611634 27614 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:24.612700 27614 raft_consensus.cc:504] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43d1015e89546ae829d03718ba6cc9a" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41295 } }
I20260812 11:06:24.613056 27614 leader_election.cc:302] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f43d1015e89546ae829d03718ba6cc9a; no voters:
I20260812 11:06:24.613397 27614 leader_election.cc:288] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:24.613545 27624 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:24.613785 27624 raft_consensus.cc:686] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [term 1 LEADER]: Becoming Leader. State: Replica: f43d1015e89546ae829d03718ba6cc9a, State: Running, Role: LEADER
I20260812 11:06:24.614126 27624 consensus_queue.cc:237] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43d1015e89546ae829d03718ba6cc9a" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41295 } }
I20260812 11:06:24.614683 27614 sys_catalog.cc:564] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:24.615935 27625 sys_catalog.cc:455] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f43d1015e89546ae829d03718ba6cc9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43d1015e89546ae829d03718ba6cc9a" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41295 } } }
I20260812 11:06:24.615939 27630 sys_catalog.cc:455] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f43d1015e89546ae829d03718ba6cc9a. Latest consensus state: current_term: 1 leader_uuid: "f43d1015e89546ae829d03718ba6cc9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f43d1015e89546ae829d03718ba6cc9a" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41295 } } }
I20260812 11:06:24.616127 27625 sys_catalog.cc:458] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:24.616127 27630 sys_catalog.cc:458] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:24.616540 27642 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:24.619387 27642 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:24.624874 27642 catalog_manager.cc:1347] Generated new cluster ID: f9a90ad669f1412989ee3eab5de8e5cf
I20260812 11:06:24.624953 27642 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:24.640041 27642 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:24.640473 27642 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:24.661409 27642 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a: Generated new TSK 0
I20260812 11:06:24.662442 27642 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:06:24.666356 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:41295
--builtin_ntp_servers=127.18.174.212:39243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 11:06:24.783646 27662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:24.783915 27662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:24.783957 27662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:24.788018 27662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:24.788102 27662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:24.788161 27662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:24.792930 27662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:41295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:24.794003 27662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:24.795414 27662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:24.805253 27676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:24.805249 27675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:24.805249 27678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:24.805640 27662 server_base.cc:1034] running on GCE node
I20260812 11:06:24.806082 27662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:24.806739 27662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:24.807911 27662 hybrid_clock.cc:648] HybridClock initialized: now 1786532784807887 us; error 37 us; skew 500 ppm
I20260812 11:06:24.809904 27662 webserver.cc:460] Webserver started at http://127.18.174.193:46843/ using document root <none> and password file <none>
I20260812 11:06:24.810531 27662 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:24.810606 27662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:24.810803 27662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:24.813035 27662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "c8f334c74b6a42dfae19c270f553f6e2"
format_stamp: "Formatted at 2026-08-12 11:06:24 on dist-test-slave-lgr5"
server_key: "80aa325e5c203549ef6b0cc1edccbf41"
server_key_iv: "b465a781bbd327be5de267c2b31210ae"
server_key_version: "encryptionkey@0"
I20260812 11:06:24.813661 27662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "c8f334c74b6a42dfae19c270f553f6e2"
format_stamp: "Formatted at 2026-08-12 11:06:24 on dist-test-slave-lgr5"
server_key: "80aa325e5c203549ef6b0cc1edccbf41"
server_key_iv: "b465a781bbd327be5de267c2b31210ae"
server_key_version: "encryptionkey@0"
I20260812 11:06:24.817726 27662 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:06:24.820506 27687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:24.821799 27662 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:24.821921 27662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "c8f334c74b6a42dfae19c270f553f6e2"
format_stamp: "Formatted at 2026-08-12 11:06:24 on dist-test-slave-lgr5"
server_key: "80aa325e5c203549ef6b0cc1edccbf41"
server_key_iv: "b465a781bbd327be5de267c2b31210ae"
server_key_version: "encryptionkey@0"
I20260812 11:06:24.822046 27662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:24.826874 27662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:24.827504 27662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:24.827672 27662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:24.828277 27662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:24.829384 27662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:24.829452 27662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:24.829511 27662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:24.829541 27662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:24.838483 27662 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:34809
I20260812 11:06:24.838516 27894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:34809 every 8 connection(s)
I20260812 11:06:24.839454 27662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:06:24.843875 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 27662
I20260812 11:06:24.843997 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:06:24.844292 19131 external_mini_cluster.cc:1428] Setting key aa801874760a1f63c54126ebc7e6956b
I20260812 11:06:24.846102 27621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.841393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:45525 (local address 127.18.174.254:41295)
0812 11:06:24.841521 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:24.841524 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:24.842715 (+ 1191us) server_negotiation.cc:407] Connection header received
0812 11:06:24.844368 (+ 1653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:24.844372 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:24.844423 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:24.844513 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:24.845664 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:24.845667 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:24.845670 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:24.845684 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:24.845703 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:24.845711 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:24.845787 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:24.845917 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 11:06:24.845965 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:06:24.846257 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:41295
--builtin_ntp_servers=127.18.174.212:39243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 11:06:24.847083 27899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:24.841765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:41295 (local address 127.18.174.193:45525)
0812 11:06:24.842541 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:24.842587 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:24.844130 (+ 1543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:24.844716 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:24.844723 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:24.844822 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:24.845385 (+ 563us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:06:24.845386 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:24.845431 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:06:24.845512 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:24.845780 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:24.845789 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:24.845795 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:06:24.845970 (+ 175us) client_negotiation.cc:240] Negotiation successful
0812 11:06:24.846246 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":125,"threads_started":1}
I20260812 11:06:24.848399 27895 heartbeater.cc:347] Connected to a master server at 127.18.174.254:41295
I20260812 11:06:24.848644 27895 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:24.849087 27895 heartbeater.cc:511] Master 127.18.174.254:41295 requested a full tablet report, sending...
I20260812 11:06:24.850735 27554 ts_manager.cc:194] Registered new tserver with Master: c8f334c74b6a42dfae19c270f553f6e2 (127.18.174.193:34809)
W20260812 11:06:24.960704 27900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:24.961014 27900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:24.961056 27900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:24.965315 27900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:24.965389 27900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:24.965449 27900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:06:24.970525 27900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:41295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:24.971829 27900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:24.973395 27900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:24.983897 27908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:24.983857 27912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:24.983876 27900 server_base.cc:1034] running on GCE node
W20260812 11:06:24.983870 27909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:24.984638 27900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:24.985347 27900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:24.986510 27900 hybrid_clock.cc:648] HybridClock initialized: now 1786532784986491 us; error 39 us; skew 500 ppm
I20260812 11:06:24.988461 27900 webserver.cc:460] Webserver started at http://127.18.174.194:33155/ using document root <none> and password file <none>
I20260812 11:06:24.989048 27900 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:24.989117 27900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:24.989320 27900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:24.991458 27900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "2dccd58796124e75836e001c85980698"
format_stamp: "Formatted at 2026-08-12 11:06:24 on dist-test-slave-lgr5"
server_key: "e71a1ebff41633112b7840a60525b3f6"
server_key_iv: "4662c07e547ada58416602a3f880c5a1"
server_key_version: "encryptionkey@0"
I20260812 11:06:24.992022 27900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "2dccd58796124e75836e001c85980698"
format_stamp: "Formatted at 2026-08-12 11:06:24 on dist-test-slave-lgr5"
server_key: "e71a1ebff41633112b7840a60525b3f6"
server_key_iv: "4662c07e547ada58416602a3f880c5a1"
server_key_version: "encryptionkey@0"
I20260812 11:06:24.995824 27900 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:06:24.998421 27928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:24.999692 27900 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 11:06:24.999811 27900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "2dccd58796124e75836e001c85980698"
format_stamp: "Formatted at 2026-08-12 11:06:24 on dist-test-slave-lgr5"
server_key: "e71a1ebff41633112b7840a60525b3f6"
server_key_iv: "4662c07e547ada58416602a3f880c5a1"
server_key_version: "encryptionkey@0"
I20260812 11:06:24.999919 27900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:25.004689 27900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:25.005323 27900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:25.005496 27900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:25.006048 27900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:25.006992 27900 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:25.007040 27900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:25.007093 27900 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:25.007123 27900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:25.015524 27900 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:36955
I20260812 11:06:25.015599 28128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:36955 every 8 connection(s)
I20260812 11:06:25.016520 27900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:06:25.022576 27621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.018347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:50687 (local address 127.18.174.254:41295)
0812 11:06:25.018484 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:25.018488 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:25.019611 (+ 1123us) server_negotiation.cc:407] Connection header received
0812 11:06:25.021010 (+ 1399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:25.021013 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:25.021056 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:25.021138 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:25.022185 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:25.022188 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:25.022190 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:25.022202 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:25.022223 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:25.022232 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:25.022342 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:25.022423 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 11:06:25.022463 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:06:25.023522 28135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.018789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:41295 (local address 127.18.174.194:50687)
0812 11:06:25.019470 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:25.019514 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:25.020775 (+ 1261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:25.021297 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:25.021303 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:25.021394 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:25.021919 (+ 525us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:06:25.021921 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:25.021963 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:06:25.022047 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:25.022324 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:25.022329 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:25.022333 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:06:25.022458 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 11:06:25.022657 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":120,"threads_started":1}
I20260812 11:06:25.023577 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 27900
I20260812 11:06:25.023684 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:06:25.023983 19131 external_mini_cluster.cc:1428] Setting key cd303495de3c193b01526a8c2f0f99dc
I20260812 11:06:25.024778 28129 heartbeater.cc:347] Connected to a master server at 127.18.174.254:41295
I20260812 11:06:25.025035 28129 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:25.025527 28129 heartbeater.cc:511] Master 127.18.174.254:41295 requested a full tablet report, sending...
I20260812 11:06:25.025990 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:41295
--builtin_ntp_servers=127.18.174.212:39243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 11:06:25.026576 27554 ts_manager.cc:194] Registered new tserver with Master: 2dccd58796124e75836e001c85980698 (127.18.174.194:36955)
W20260812 11:06:25.143734 28137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:25.144029 28137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:25.144070 28137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:25.148283 28137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:25.148347 28137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:25.148417 28137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:06:25.153420 28137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:41295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:25.154582 28137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:25.156038 28137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:25.166285 28144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:25.166285 28151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:25.166342 28156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:25.166927 28137 server_base.cc:1034] running on GCE node
I20260812 11:06:25.167387 28137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:25.168126 28137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:25.169297 28137 hybrid_clock.cc:648] HybridClock initialized: now 1786532785169274 us; error 36 us; skew 500 ppm
I20260812 11:06:25.171270 28137 webserver.cc:460] Webserver started at http://127.18.174.195:41619/ using document root <none> and password file <none>
I20260812 11:06:25.171878 28137 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:25.171952 28137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:25.172223 28137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:25.174530 28137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "38e81e5ee27a4a019052630a4b13a8a9"
format_stamp: "Formatted at 2026-08-12 11:06:25 on dist-test-slave-lgr5"
server_key: "1563b6ee8415eff52686e6843e00987e"
server_key_iv: "cf3cdb50c584025e5b9878dafa07b0ba"
server_key_version: "encryptionkey@0"
I20260812 11:06:25.175168 28137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "38e81e5ee27a4a019052630a4b13a8a9"
format_stamp: "Formatted at 2026-08-12 11:06:25 on dist-test-slave-lgr5"
server_key: "1563b6ee8415eff52686e6843e00987e"
server_key_iv: "cf3cdb50c584025e5b9878dafa07b0ba"
server_key_version: "encryptionkey@0"
I20260812 11:06:25.179128 28137 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260812 11:06:25.181988 28163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:25.183349 28137 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:25.183471 28137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "38e81e5ee27a4a019052630a4b13a8a9"
format_stamp: "Formatted at 2026-08-12 11:06:25 on dist-test-slave-lgr5"
server_key: "1563b6ee8415eff52686e6843e00987e"
server_key_iv: "cf3cdb50c584025e5b9878dafa07b0ba"
server_key_version: "encryptionkey@0"
I20260812 11:06:25.183590 28137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:25.188522 28137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:25.189215 28137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:25.189395 28137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:25.189996 28137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:25.190970 28137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:25.191027 28137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:25.191082 28137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:25.191110 28137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:25.199657 28137 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:36303
I20260812 11:06:25.199708 28385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:36303 every 8 connection(s)
I20260812 11:06:25.200645 28137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:06:25.203512 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 28137
I20260812 11:06:25.203652 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:06:25.203943 19131 external_mini_cluster.cc:1428] Setting key 3f499cc4ae3fc5df0cacccae142ab254
I20260812 11:06:25.207156 27621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.202512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:49239 (local address 127.18.174.254:41295)
0812 11:06:25.202662 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:25.202666 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:25.203844 (+ 1178us) server_negotiation.cc:407] Connection header received
0812 11:06:25.205462 (+ 1618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:25.205465 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:25.205518 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:25.205593 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:25.206710 (+ 1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:25.206714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:25.206716 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:25.206730 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:25.206752 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:25.206760 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:25.206836 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:25.206971 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 11:06:25.207018 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:06:25.208120 28392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.202920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:41295 (local address 127.18.174.195:49239)
0812 11:06:25.203673 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:25.203733 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:25.205234 (+ 1501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:25.205788 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:25.205796 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:25.205920 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:25.206448 (+ 528us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:06:25.206449 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:25.206493 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:06:25.206570 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:25.206833 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:25.206842 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:25.206849 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 11:06:25.207030 (+ 181us) client_negotiation.cc:240] Negotiation successful
0812 11:06:25.207295 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":125,"threads_started":1}
I20260812 11:06:25.209229 28390 heartbeater.cc:347] Connected to a master server at 127.18.174.254:41295
I20260812 11:06:25.209504 28390 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:25.209969 28390 heartbeater.cc:511] Master 127.18.174.254:41295 requested a full tablet report, sending...
I20260812 11:06:25.211158 27554 ts_manager.cc:194] Registered new tserver with Master: 38e81e5ee27a4a019052630a4b13a8a9 (127.18.174.195:36303)
I20260812 11:06:25.217917 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:06:25.221313 27621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.219871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33764 (local address 127.18.174.254:41295)
0812 11:06:25.219987 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:25.219991 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:25.220182 (+ 191us) server_negotiation.cc:407] Connection header received
0812 11:06:25.220294 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:25.220296 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:25.220334 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:25.220402 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:25.221016 (+ 614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:25.221019 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:25.221021 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:25.221032 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:25.221052 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:25.221060 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:25.221126 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:25.221168 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 11:06:25.221203 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:06:25.224192 27554 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33764:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:06:25.227442 27554 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:25.240424 28406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.236850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:36303 (local address 127.0.0.1:48134)
0812 11:06:25.237707 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:25.237760 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:25.237869 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:25.238887 (+ 1018us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:25.238891 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:25.238907 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:25.239534 (+ 627us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:06:25.239536 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:25.239548 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:06:25.239579 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:25.240172 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:25.240175 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:25.240178 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 11:06:25.240238 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 11:06:25.240293 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"mutex_wait_us":17,"thread_start_us":118,"threads_started":1}
I20260812 11:06:25.240641 28408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.237043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48134 (local address 127.18.174.195:36303)
0812 11:06:25.238504 (+ 1461us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:25.238515 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:25.238535 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:06:25.238583 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:25.238588 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:25.238741 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:25.239128 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:25.239953 (+ 825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:25.239959 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:25.239969 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:25.239980 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:25.240020 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:25.240046 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:25.240342 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:25.240394 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 11:06:25.240486 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1339,"thread_start_us":132,"threads_started":1}
I20260812 11:06:25.240788 28410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.237040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:34809 (local address 127.0.0.1:56202)
0812 11:06:25.238137 (+ 1097us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:25.238150 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:25.238246 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:25.238709 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:25.238715 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:25.238795 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:25.239397 (+ 602us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:06:25.239398 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:25.239419 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:06:25.239491 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:25.240166 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:25.240169 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:25.240172 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 11:06:25.240225 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 11:06:25.240436 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1043,"mutex_wait_us":18,"thread_start_us":99,"threads_started":1}
I20260812 11:06:25.241132 28414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.237702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33602 (local address 127.18.174.194:36955)
0812 11:06:25.238271 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:25.238282 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:25.238376 (+ 94us) server_negotiation.cc:407] Connection header received
0812 11:06:25.238448 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:25.238453 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:25.238602 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:25.238722 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:25.239863 (+ 1141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:25.239868 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:25.239878 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:25.239888 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:25.239925 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:25.239949 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:25.240057 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:25.240857 (+ 800us) server_negotiation.cc:299] Negotiation successful
0812 11:06:25.241010 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":123,"threads_started":1}
I20260812 11:06:25.240424 28407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.237235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:36955 (local address 127.0.0.1:33602)
0812 11:06:25.238289 (+ 1054us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:25.238300 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:25.238368 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:25.239348 (+ 980us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:25.239352 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:25.239366 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:25.239723 (+ 357us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:06:25.239724 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:25.239733 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:06:25.239753 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:25.240027 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:25.240037 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:25.240044 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 11:06:25.240177 (+ 133us) client_negotiation.cc:240] Negotiation successful
0812 11:06:25.240264 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1000,"thread_start_us":107,"threads_started":1}
I20260812 11:06:25.241591 28413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.237703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56202 (local address 127.18.174.193:34809)
0812 11:06:25.238138 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:25.238157 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:25.238256 (+ 99us) server_negotiation.cc:407] Connection header received
0812 11:06:25.238334 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:25.238340 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:25.238550 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:25.238694 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:25.239957 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:25.239961 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:25.239983 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:25.239992 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:25.240027 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:25.240049 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:25.241267 (+ 1218us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:25.241382 (+ 115us) server_negotiation.cc:299] Negotiation successful
0812 11:06:25.241452 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":91,"threads_started":1}
I20260812 11:06:25.243844 27768 tablet_service.cc:1467] Processing CreateTablet for tablet c415a5dfef9741d9936320332f600a75 (DEFAULT_TABLE table=test-table [id=8c8a76561235496db8ed0798d461869a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:25.243846 28013 tablet_service.cc:1467] Processing CreateTablet for tablet c415a5dfef9741d9936320332f600a75 (DEFAULT_TABLE table=test-table [id=8c8a76561235496db8ed0798d461869a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:25.243845 28257 tablet_service.cc:1467] Processing CreateTablet for tablet c415a5dfef9741d9936320332f600a75 (DEFAULT_TABLE table=test-table [id=8c8a76561235496db8ed0798d461869a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:25.244997 27768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c415a5dfef9741d9936320332f600a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:25.245014 28013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c415a5dfef9741d9936320332f600a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:25.245011 28257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c415a5dfef9741d9936320332f600a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:25.251633 28415 tablet_bootstrap.cc:492] T c415a5dfef9741d9936320332f600a75 P c8f334c74b6a42dfae19c270f553f6e2: Bootstrap starting.
I20260812 11:06:25.253154 28423 tablet_bootstrap.cc:492] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698: Bootstrap starting.
I20260812 11:06:25.253593 28416 tablet_bootstrap.cc:492] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9: Bootstrap starting.
I20260812 11:06:25.254417 28415 tablet_bootstrap.cc:654] T c415a5dfef9741d9936320332f600a75 P c8f334c74b6a42dfae19c270f553f6e2: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:25.255427 28415 log.cc:824] T c415a5dfef9741d9936320332f600a75 P c8f334c74b6a42dfae19c270f553f6e2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:25.255965 28416 tablet_bootstrap.cc:654] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:25.256929 28416 log.cc:824] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:25.257613 28415 tablet_bootstrap.cc:492] T c415a5dfef9741d9936320332f600a75 P c8f334c74b6a42dfae19c270f553f6e2: No bootstrap required, opened a new log
I20260812 11:06:25.257843 28415 ts_tablet_manager.cc:1397] T c415a5dfef9741d9936320332f600a75 P c8f334c74b6a42dfae19c270f553f6e2: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:06:25.258193 28423 tablet_bootstrap.cc:654] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:25.259073 28423 log.cc:824] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:25.259204 28416 tablet_bootstrap.cc:492] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9: No bootstrap required, opened a new log
I20260812 11:06:25.259402 28416 ts_tablet_manager.cc:1397] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:06:25.261436 28423 tablet_bootstrap.cc:492] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698: No bootstrap required, opened a new log
I20260812 11:06:25.261663 28423 ts_tablet_manager.cc:1397] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260812 11:06:25.262447 28415 raft_consensus.cc:348] T c415a5dfef9741d9936320332f600a75 P c8f334c74b6a42dfae19c270f553f6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e81e5ee27a4a019052630a4b13a8a9" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36303 } } peers { permanent_uuid: "c8f334c74b6a42dfae19c270f553f6e2" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34809 } } peers { permanent_uuid: "2dccd58796124e75836e001c85980698" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 36955 } }
I20260812 11:06:25.262787 28415 raft_consensus.cc:374] T c415a5dfef9741d9936320332f600a75 P c8f334c74b6a42dfae19c270f553f6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:25.262846 28415 raft_consensus.cc:729] T c415a5dfef9741d9936320332f600a75 P c8f334c74b6a42dfae19c270f553f6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8f334c74b6a42dfae19c270f553f6e2, State: Initialized, Role: FOLLOWER
I20260812 11:06:25.263203 28416 raft_consensus.cc:348] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e81e5ee27a4a019052630a4b13a8a9" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36303 } } peers { permanent_uuid: "c8f334c74b6a42dfae19c270f553f6e2" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34809 } } peers { permanent_uuid: "2dccd58796124e75836e001c85980698" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 36955 } }
I20260812 11:06:25.263448 28416 raft_consensus.cc:374] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:25.263378 28415 consensus_queue.cc:260] T c415a5dfef9741d9936320332f600a75 P c8f334c74b6a42dfae19c270f553f6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e81e5ee27a4a019052630a4b13a8a9" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36303 } } peers { permanent_uuid: "c8f334c74b6a42dfae19c270f553f6e2" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34809 } } peers { permanent_uuid: "2dccd58796124e75836e001c85980698" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 36955 } }
I20260812 11:06:25.263510 28416 raft_consensus.cc:729] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38e81e5ee27a4a019052630a4b13a8a9, State: Initialized, Role: FOLLOWER
I20260812 11:06:25.264019 28416 consensus_queue.cc:260] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e81e5ee27a4a019052630a4b13a8a9" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36303 } } peers { permanent_uuid: "c8f334c74b6a42dfae19c270f553f6e2" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34809 } } peers { permanent_uuid: "2dccd58796124e75836e001c85980698" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 36955 } }
I20260812 11:06:25.264200 27895 heartbeater.cc:503] Master 127.18.174.254:41295 was elected leader, sending a full tablet report...
I20260812 11:06:25.264611 28415 ts_tablet_manager.cc:1428] T c415a5dfef9741d9936320332f600a75 P c8f334c74b6a42dfae19c270f553f6e2: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260812 11:06:25.265039 28416 ts_tablet_manager.cc:1428] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 11:06:25.265419 28390 heartbeater.cc:503] Master 127.18.174.254:41295 was elected leader, sending a full tablet report...
I20260812 11:06:25.265607 28431 raft_consensus.cc:482] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:25.265753 28431 raft_consensus.cc:504] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e81e5ee27a4a019052630a4b13a8a9" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36303 } } peers { permanent_uuid: "c8f334c74b6a42dfae19c270f553f6e2" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34809 } } peers { permanent_uuid: "2dccd58796124e75836e001c85980698" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 36955 } }
I20260812 11:06:25.266582 28423 raft_consensus.cc:348] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e81e5ee27a4a019052630a4b13a8a9" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36303 } } peers { permanent_uuid: "c8f334c74b6a42dfae19c270f553f6e2" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34809 } } peers { permanent_uuid: "2dccd58796124e75836e001c85980698" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 36955 } }
I20260812 11:06:25.266870 28423 raft_consensus.cc:374] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:25.266932 28423 raft_consensus.cc:729] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dccd58796124e75836e001c85980698, State: Initialized, Role: FOLLOWER
I20260812 11:06:25.267221 28431 leader_election.cc:288] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8f334c74b6a42dfae19c270f553f6e2 (127.18.174.193:34809), 2dccd58796124e75836e001c85980698 (127.18.174.194:36955)
I20260812 11:06:25.267447 28423 consensus_queue.cc:260] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e81e5ee27a4a019052630a4b13a8a9" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36303 } } peers { permanent_uuid: "c8f334c74b6a42dfae19c270f553f6e2" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34809 } } peers { permanent_uuid: "2dccd58796124e75836e001c85980698" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 36955 } }
I20260812 11:06:25.268556 28423 ts_tablet_manager.cc:1428] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 11:06:25.269059 28129 heartbeater.cc:503] Master 127.18.174.254:41295 was elected leader, sending a full tablet report...
I20260812 11:06:25.269209 28392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.267193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:34809 (local address 127.18.174.195:58739)
0812 11:06:25.267640 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:25.267654 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:25.267734 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:25.268073 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:25.268099 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:25.268115 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:25.268616 (+ 501us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:06:25.268618 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:25.268630 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:06:25.268661 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:25.268942 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:25.268945 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:25.268949 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:06:25.269050 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 11:06:25.269089 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379}
I20260812 11:06:25.269517 28413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.267455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:58739 (local address 127.18.174.193:34809)
0812 11:06:25.267573 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:25.267578 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:25.267815 (+ 237us) server_negotiation.cc:407] Connection header received
0812 11:06:25.267861 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:25.267863 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:25.267900 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:25.267966 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:25.268785 (+ 819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:25.268789 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:25.268792 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:25.268803 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:25.268824 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:25.268833 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:25.268917 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:25.269361 (+ 444us) server_negotiation.cc:299] Negotiation successful
0812 11:06:25.269404 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:06:25.271109 27815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c415a5dfef9741d9936320332f600a75" candidate_uuid: "38e81e5ee27a4a019052630a4b13a8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8f334c74b6a42dfae19c270f553f6e2" is_pre_election: true
I20260812 11:06:25.271431 27815 raft_consensus.cc:2454] T c415a5dfef9741d9936320332f600a75 P c8f334c74b6a42dfae19c270f553f6e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38e81e5ee27a4a019052630a4b13a8a9 in term 0.
I20260812 11:06:25.272040 28414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.267915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:45455 (local address 127.18.174.194:36955)
0812 11:06:25.268110 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:25.268115 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:25.268537 (+ 422us) server_negotiation.cc:407] Connection header received
0812 11:06:25.270108 (+ 1571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:25.270112 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:25.270150 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:25.270200 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:25.271515 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:25.271519 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:25.271521 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:25.271534 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:25.271555 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:25.271565 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:25.271645 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:25.271873 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 11:06:25.271914 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 11:06:25.271996 28173 leader_election.cc:302] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38e81e5ee27a4a019052630a4b13a8a9, c8f334c74b6a42dfae19c270f553f6e2; no voters:
I20260812 11:06:25.272420 28431 raft_consensus.cc:2781] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:25.272531 28431 raft_consensus.cc:482] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:25.272585 28431 raft_consensus.cc:3037] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:25.272596 28435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.267193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:36955 (local address 127.18.174.195:45455)
0812 11:06:25.268428 (+ 1235us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:25.268441 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:25.269973 (+ 1532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:25.270327 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:25.270330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:25.270347 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:25.271357 (+ 1010us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:06:25.271360 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:25.271371 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:06:25.271402 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:25.271760 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:25.271763 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:25.271767 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:06:25.272411 (+ 644us) client_negotiation.cc:240] Negotiation successful
0812 11:06:25.272453 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1166,"mutex_wait_us":134,"thread_start_us":103,"threads_started":1}
I20260812 11:06:25.273196 28046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c415a5dfef9741d9936320332f600a75" candidate_uuid: "38e81e5ee27a4a019052630a4b13a8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dccd58796124e75836e001c85980698" is_pre_election: true
I20260812 11:06:25.273476 28046 raft_consensus.cc:2454] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38e81e5ee27a4a019052630a4b13a8a9 in term 0.
I20260812 11:06:25.273859 28431 raft_consensus.cc:504] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e81e5ee27a4a019052630a4b13a8a9" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36303 } } peers { permanent_uuid: "c8f334c74b6a42dfae19c270f553f6e2" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34809 } } peers { permanent_uuid: "2dccd58796124e75836e001c85980698" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 36955 } }
I20260812 11:06:25.274206 28431 leader_election.cc:288] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [CANDIDATE]: Term 1 election: Requested vote from peers c8f334c74b6a42dfae19c270f553f6e2 (127.18.174.193:34809), 2dccd58796124e75836e001c85980698 (127.18.174.194:36955)
I20260812 11:06:25.274569 28046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c415a5dfef9741d9936320332f600a75" candidate_uuid: "38e81e5ee27a4a019052630a4b13a8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dccd58796124e75836e001c85980698"
I20260812 11:06:25.274576 27815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c415a5dfef9741d9936320332f600a75" candidate_uuid: "38e81e5ee27a4a019052630a4b13a8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8f334c74b6a42dfae19c270f553f6e2"
I20260812 11:06:25.274698 28046 raft_consensus.cc:3037] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:25.274708 27815 raft_consensus.cc:3037] T c415a5dfef9741d9936320332f600a75 P c8f334c74b6a42dfae19c270f553f6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:25.275807 28046 raft_consensus.cc:2454] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38e81e5ee27a4a019052630a4b13a8a9 in term 1.
I20260812 11:06:25.275947 27815 raft_consensus.cc:2454] T c415a5dfef9741d9936320332f600a75 P c8f334c74b6a42dfae19c270f553f6e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38e81e5ee27a4a019052630a4b13a8a9 in term 1.
I20260812 11:06:25.276206 28174 leader_election.cc:302] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dccd58796124e75836e001c85980698, 38e81e5ee27a4a019052630a4b13a8a9; no voters:
I20260812 11:06:25.276361 28431 raft_consensus.cc:2781] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:25.276466 28431 raft_consensus.cc:686] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [term 1 LEADER]: Becoming Leader. State: Replica: 38e81e5ee27a4a019052630a4b13a8a9, State: Running, Role: LEADER
I20260812 11:06:25.276772 28431 consensus_queue.cc:237] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e81e5ee27a4a019052630a4b13a8a9" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36303 } } peers { permanent_uuid: "c8f334c74b6a42dfae19c270f553f6e2" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34809 } } peers { permanent_uuid: "2dccd58796124e75836e001c85980698" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 36955 } }
I20260812 11:06:25.280058 27554 catalog_manager.cc:5495] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38e81e5ee27a4a019052630a4b13a8a9 (127.18.174.195). New cstate: current_term: 1 leader_uuid: "38e81e5ee27a4a019052630a4b13a8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e81e5ee27a4a019052630a4b13a8a9" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8f334c74b6a42dfae19c270f553f6e2" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2dccd58796124e75836e001c85980698" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 36955 } health_report { overall_health: UNKNOWN } } }
I20260812 11:06:25.291570 28408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.290149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48146 (local address 127.18.174.195:36303)
0812 11:06:25.290276 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:25.290281 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:25.290295 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:06:25.290441 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:25.290444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:25.290507 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:25.290577 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:25.291199 (+ 622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:25.291202 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:25.291205 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:25.291217 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:25.291237 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:25.291244 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:25.291320 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:25.291397 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 11:06:25.291438 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:06:25.298064 28046 raft_consensus.cc:1261] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698 [term 1 FOLLOWER]: Refusing update from remote peer 38e81e5ee27a4a019052630a4b13a8a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:25.298787 27815 raft_consensus.cc:1261] T c415a5dfef9741d9936320332f600a75 P c8f334c74b6a42dfae19c270f553f6e2 [term 1 FOLLOWER]: Refusing update from remote peer 38e81e5ee27a4a019052630a4b13a8a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:25.298853 28431 consensus_queue.cc:1035] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dccd58796124e75836e001c85980698" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:25.299428 28431 consensus_queue.cc:1035] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8f334c74b6a42dfae19c270f553f6e2" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:25.307741 28448 mvcc.cc:205] Tried to move back new op lower bound from 7317638288572174336 to 7317638288496951296. Current Snapshot: MvccSnapshot[applied={T|T < 7317638288572174336}]
I20260812 11:06:25.316792 27548 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:25.316988 27548 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:25.319669 27548 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f43d1015e89546ae829d03718ba6cc9a: Sending DeleteTablet for 3 replicas of tablet c415a5dfef9741d9936320332f600a75
I20260812 11:06:25.320662 28257 tablet_service.cc:1514] Processing DeleteTablet for tablet c415a5dfef9741d9936320332f600a75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:25 UTC) from {username='slave'} at 127.0.0.1:48134
I20260812 11:06:25.320837 27768 tablet_service.cc:1514] Processing DeleteTablet for tablet c415a5dfef9741d9936320332f600a75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:25 UTC) from {username='slave'} at 127.0.0.1:56202
I20260812 11:06:25.321254 28461 tablet_replica.cc:330] T c415a5dfef9741d9936320332f600a75 P c8f334c74b6a42dfae19c270f553f6e2: stopping tablet replica
I20260812 11:06:25.321240 28013 tablet_service.cc:1514] Processing DeleteTablet for tablet c415a5dfef9741d9936320332f600a75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:25 UTC) from {username='slave'} at 127.0.0.1:33602
I20260812 11:06:25.321429 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 27662
I20260812 11:06:25.324738 28464 tablet_replica.cc:330] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698: stopping tablet replica
I20260812 11:06:25.325228 28464 raft_consensus.cc:2229] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:25.325697 28464 raft_consensus.cc:2258] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:25.336282 28464 ts_tablet_manager.cc:1905] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:25.339058 28459 tablet_replica.cc:330] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9: stopping tablet replica
I20260812 11:06:25.339210 28464 ts_tablet_manager.cc:1918] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:25.339339 28464 log.cc:1196] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/c415a5dfef9741d9936320332f600a75
I20260812 11:06:25.339648 28464 ts_tablet_manager.cc:1939] T c415a5dfef9741d9936320332f600a75 P 2dccd58796124e75836e001c85980698: Deleting consensus metadata
I20260812 11:06:25.339654 28459 raft_consensus.cc:2229] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:06:25.340287 28459 raft_consensus.cc:2258] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:25.341126 27529 catalog_manager.cc:4841] TS 2dccd58796124e75836e001c85980698 (127.18.174.194:36955): tablet c415a5dfef9741d9936320332f600a75 (table test-table [id=8c8a76561235496db8ed0798d461869a]) successfully deleted
I20260812 11:06:25.342204 28459 ts_tablet_manager.cc:1905] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 11:06:25.344805 27527 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:34809 (error 108)
I20260812 11:06:25.345130 28459 ts_tablet_manager.cc:1918] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:25.345250 28459 log.cc:1196] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/c415a5dfef9741d9936320332f600a75
I20260812 11:06:25.345599 28459 ts_tablet_manager.cc:1939] T c415a5dfef9741d9936320332f600a75 P 38e81e5ee27a4a019052630a4b13a8a9: Deleting consensus metadata
I20260812 11:06:25.346040 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 27900
I20260812 11:06:25.346064 28407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.345747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:34809 (local address 127.0.0.1:56216)
0812 11:06:25.345879 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:25.345958 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:34809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 11:06:25.346880 27525 catalog_manager.cc:4841] TS 38e81e5ee27a4a019052630a4b13a8a9 (127.18.174.195:36303): tablet c415a5dfef9741d9936320332f600a75 (table test-table [id=8c8a76561235496db8ed0798d461869a]) successfully deleted
W20260812 11:06:25.349290 27527 catalog_manager.cc:4584] TS c8f334c74b6a42dfae19c270f553f6e2 (127.18.174.193:34809): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c415a5dfef9741d9936320332f600a75: Network error: Client connection negotiation failed: client connection to 127.18.174.193:34809: connect: Connection refused (error 111)
I20260812 11:06:25.356901 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 28137
I20260812 11:06:25.375200 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 27501
2026-08-12T11:06:25Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (990 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 11:06:25.409353 19131 mini_oidc.cc:152] Starting JWKS server
I20260812 11:06:25.411275 19131 webserver.cc:460] Webserver started at https://127.0.0.1:33627/ using document root <none> and password file <none>
I20260812 11:06:25.411446 19131 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 11:06:25.411711 19131 webserver.cc:460] Webserver started at http://127.0.0.1:37649/ using document root <none> and password file <none>
2026-08-12T11:06:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:25Z Disabled control of system clock
I20260812 11:06:25.422873 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:33267
--webserver_interface=127.18.174.254
--webserver_port=0
--builtin_ntp_servers=127.18.174.212:33815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:33267
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33627/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/testchainca.cert with env {}
W20260812 11:06:25.539078 28481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:25.539372 28481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:25.539413 28481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:25.543468 28481 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:25.543537 28481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:25.543551 28481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:25.543566 28481 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:25.543581 28481 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:06:25.543596 28481 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:06:25.543607 28481 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33627/jwks.json
I20260812 11:06:25.549193 28481 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:33815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:33267
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:33267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33627/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:25.550298 28481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:25.551327 28481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:25.560397 28498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:25.560465 28481 server_base.cc:1034] running on GCE node
W20260812 11:06:25.560379 28494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:25.560385 28495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:25.561314 28481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:25.562503 28481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:25.563673 28481 hybrid_clock.cc:648] HybridClock initialized: now 1786532785563653 us; error 35 us; skew 500 ppm
I20260812 11:06:25.565670 28481 webserver.cc:460] Webserver started at http://127.18.174.254:37813/ using document root <none> and password file <none>
I20260812 11:06:25.566289 28481 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:25.566365 28481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:25.566570 28481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:25.568828 28481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "32a93b380702455bb80a104c1e505e14"
format_stamp: "Formatted at 2026-08-12 11:06:25 on dist-test-slave-lgr5"
server_key: "9d964dc4a3ebbb170ec62e4ba260e497"
server_key_iv: "bdee5dfc2ac9cb59e9b939351feb962c"
server_key_version: "encryptionkey@0"
I20260812 11:06:25.569435 28481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "32a93b380702455bb80a104c1e505e14"
format_stamp: "Formatted at 2026-08-12 11:06:25 on dist-test-slave-lgr5"
server_key: "9d964dc4a3ebbb170ec62e4ba260e497"
server_key_iv: "bdee5dfc2ac9cb59e9b939351feb962c"
server_key_version: "encryptionkey@0"
I20260812 11:06:25.573251 28481 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260812 11:06:25.575765 28506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:25.577099 28481 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:06:25.577226 28481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "32a93b380702455bb80a104c1e505e14"
format_stamp: "Formatted at 2026-08-12 11:06:25 on dist-test-slave-lgr5"
server_key: "9d964dc4a3ebbb170ec62e4ba260e497"
server_key_iv: "bdee5dfc2ac9cb59e9b939351feb962c"
server_key_version: "encryptionkey@0"
I20260812 11:06:25.577337 28481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:25.589883 28481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:25.590576 28481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:25.590755 28481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:25.597671 28481 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:33267
I20260812 11:06:25.597685 28611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:33267 every 8 connection(s)
I20260812 11:06:25.598656 28481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:25.600121 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 28481
I20260812 11:06:25.600297 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:25.600637 19131 external_mini_cluster.cc:1428] Setting key b7bc67ee89c1913d24ec0461884acebd
I20260812 11:06:25.602800 28617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:25.609372 28617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14: Bootstrap starting.
I20260812 11:06:25.610539 28620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.602074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48434 (local address 127.18.174.254:33267)
0812 11:06:25.602755 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:25.602770 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:25.602807 (+ 37us) server_negotiation.cc:407] Connection header received
0812 11:06:25.603494 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:25.603512 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:25.603918 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:25.604273 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:25.604715 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:25.605697 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:25.606604 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:25.607086 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:25.607234 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:25.608202 (+ 968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:25.608209 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:25.608226 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:25.608718 (+ 492us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:25.608811 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:25.608839 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:25.608940 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:25.609287 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 11:06:25.609584 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":159,"threads_started":1}
I20260812 11:06:25.612073 28617 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:25.613044 28617 log.cc:824] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:25.613706 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:06:25.615448 28617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14: No bootstrap required, opened a new log
I20260812 11:06:25.619065 28617 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a93b380702455bb80a104c1e505e14" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33267 } }
I20260812 11:06:25.619323 28617 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:25.619385 28617 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32a93b380702455bb80a104c1e505e14, State: Initialized, Role: FOLLOWER
I20260812 11:06:25.619864 28617 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a93b380702455bb80a104c1e505e14" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33267 } }
I20260812 11:06:25.620008 28617 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:25.620095 28617 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:25.620205 28617 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:25.621181 28617 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a93b380702455bb80a104c1e505e14" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33267 } }
I20260812 11:06:25.621573 28617 leader_election.cc:302] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32a93b380702455bb80a104c1e505e14; no voters:
I20260812 11:06:25.621897 28617 leader_election.cc:288] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:25.622030 28625 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:25.622249 28625 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [term 1 LEADER]: Becoming Leader. State: Replica: 32a93b380702455bb80a104c1e505e14, State: Running, Role: LEADER
I20260812 11:06:25.622571 28625 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a93b380702455bb80a104c1e505e14" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33267 } }
I20260812 11:06:25.623142 28617 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:25.624221 28628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32a93b380702455bb80a104c1e505e14. Latest consensus state: current_term: 1 leader_uuid: "32a93b380702455bb80a104c1e505e14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a93b380702455bb80a104c1e505e14" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33267 } } }
I20260812 11:06:25.624374 28628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:25.624646 28627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32a93b380702455bb80a104c1e505e14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a93b380702455bb80a104c1e505e14" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33267 } } }
I20260812 11:06:25.624763 28627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:25.624845 28639 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:25.627929 28639 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:25.634269 28639 catalog_manager.cc:1347] Generated new cluster ID: 7a6a122268d7433f87da381622c47693
I20260812 11:06:25.634358 28639 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:25.646461 28639 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:25.647501 28639 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:25.656960 28639 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32a93b380702455bb80a104c1e505e14: Generated new TSK 0
I20260812 11:06:25.657720 28639 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 11:06:25.685695 28673 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 11:06:25.685859 28673 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 11:06:25.686540 28620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.667550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48448 (local address 127.18.174.254:33267)
0812 11:06:25.667686 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:25.667691 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:25.667884 (+ 193us) server_negotiation.cc:407] Connection header received
0812 11:06:25.668118 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:25.668122 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:25.668182 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:25.668300 (+ 118us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:06:25.668595 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:25.669436 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:25.670348 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:25.670692 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:25.670801 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:25.671109 (+ 308us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:06:25.686086 (+ 14977us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33627/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 11:06:25.686393 (+ 307us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48448: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33627/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":47}
W20260812 11:06:25.686610 28620 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48448: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33627/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 11:06:25.687824 28672 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:25.667421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:33267 (local address 127.0.0.1:48448)
0812 11:06:25.667795 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:25.667808 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:25.667932 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:25.668338 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:25.668342 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:25.668352 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:06:25.668471 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:25.668477 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:25.669576 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:25.669579 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:25.670234 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:25.670243 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:25.670796 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:25.670799 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:25.670873 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:25.670923 (+ 50us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:06:25.686330 (+ 15407us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33627/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 11:06:25.686546 (+ 216us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.174.254:33267: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33627/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":125,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.18.174.254:33267: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33627/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 11:06:25.688552 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 28481
2026-08-12T11:06:25Z chronyd exiting
I20260812 11:06:25.735786 19131 test_util.cc:175] -----------------------------------------------
I20260812 11:06:25.735882 19131 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532756485707-19131-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (328 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 11:06:25.737100 19131 mini_oidc.cc:152] Starting JWKS server
I20260812 11:06:25.737982 19131 webserver.cc:460] Webserver started at https://127.0.0.1:46515/ using document root <none> and password file <none>
I20260812 11:06:25.738087 19131 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 11:06:25.738350 19131 webserver.cc:460] Webserver started at http://127.0.0.1:37563/ using document root <none> and password file <none>
2026-08-12T11:06:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:25Z Disabled control of system clock
I20260812 11:06:25.748337 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:34011
--webserver_interface=127.18.174.254
--webserver_port=0
--builtin_ntp_servers=127.18.174.212:37453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:34011
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46515/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/testchainca.cert with env {}
W20260812 11:06:25.864967 28680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:25.865274 28680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:25.865324 28680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:25.869518 28680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:25.869598 28680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:25.869612 28680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:25.869629 28680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:25.869643 28680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:06:25.869658 28680 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:06:25.869670 28680 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46515/jwks.json
I20260812 11:06:25.875428 28680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:37453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:34011
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:34011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46515/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:25.876623 28680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:25.877653 28680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:25.886381 28688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:25.886407 28695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:25.886384 28693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:25.886698 28680 server_base.cc:1034] running on GCE node
I20260812 11:06:25.887287 28680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:25.888504 28680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:25.889667 28680 hybrid_clock.cc:648] HybridClock initialized: now 1786532785889652 us; error 30 us; skew 500 ppm
I20260812 11:06:25.891635 28680 webserver.cc:460] Webserver started at http://127.18.174.254:32895/ using document root <none> and password file <none>
I20260812 11:06:25.892274 28680 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:25.892341 28680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:25.892560 28680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:25.894754 28680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "352f709e558f4fe8b3a0546784d8df02"
format_stamp: "Formatted at 2026-08-12 11:06:25 on dist-test-slave-lgr5"
server_key: "273d081f5122f704d7863feec4c1a6c1"
server_key_iv: "0721c2efd3568b7cc27f05173ff8c6aa"
server_key_version: "encryptionkey@0"
I20260812 11:06:25.895350 28680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "352f709e558f4fe8b3a0546784d8df02"
format_stamp: "Formatted at 2026-08-12 11:06:25 on dist-test-slave-lgr5"
server_key: "273d081f5122f704d7863feec4c1a6c1"
server_key_iv: "0721c2efd3568b7cc27f05173ff8c6aa"
server_key_version: "encryptionkey@0"
I20260812 11:06:25.899185 28680 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:06:25.901705 28708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:25.902958 28680 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:06:25.903079 28680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "352f709e558f4fe8b3a0546784d8df02"
format_stamp: "Formatted at 2026-08-12 11:06:25 on dist-test-slave-lgr5"
server_key: "273d081f5122f704d7863feec4c1a6c1"
server_key_iv: "0721c2efd3568b7cc27f05173ff8c6aa"
server_key_version: "encryptionkey@0"
I20260812 11:06:25.903184 28680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:25.924822 28680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:25.925559 28680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:25.925750 28680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:25.932677 28680 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:34011
I20260812 11:06:25.932709 28808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:34011 every 8 connection(s)
I20260812 11:06:25.933696 28680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:25.934401 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 28680
I20260812 11:06:25.934516 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:25.934796 19131 external_mini_cluster.cc:1428] Setting key 0d1722357b08dd2efdac15c4eeeb8ceb
I20260812 11:06:25.937475 28809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:25.943327 28809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02: Bootstrap starting.
I20260812 11:06:25.944139 28813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:25.936267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51890 (local address 127.18.174.254:34011)
0812 11:06:25.936964 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:25.936982 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:25.937020 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:06:25.937762 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:25.937784 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:25.938206 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:25.938548 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:25.938991 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:25.939957 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:25.940894 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:25.941367 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:25.941529 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:25.942351 (+ 822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:25.942356 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:25.942369 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:25.942766 (+ 397us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:25.942823 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:25.942845 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:25.942931 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:25.943093 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 11:06:25.943350 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":167,"threads_started":1}
I20260812 11:06:25.945865 28809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:25.946661 28809 log.cc:824] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:25.947284 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:06:25.948985 28809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02: No bootstrap required, opened a new log
I20260812 11:06:25.952666 28809 raft_consensus.cc:348] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "352f709e558f4fe8b3a0546784d8df02" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 34011 } }
I20260812 11:06:25.952899 28809 raft_consensus.cc:374] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:25.952952 28809 raft_consensus.cc:729] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 352f709e558f4fe8b3a0546784d8df02, State: Initialized, Role: FOLLOWER
I20260812 11:06:25.953385 28809 consensus_queue.cc:260] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "352f709e558f4fe8b3a0546784d8df02" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 34011 } }
I20260812 11:06:25.953526 28809 raft_consensus.cc:388] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:25.953591 28809 raft_consensus.cc:482] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:25.953692 28809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:25.954599 28809 raft_consensus.cc:504] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "352f709e558f4fe8b3a0546784d8df02" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 34011 } }
I20260812 11:06:25.954936 28809 leader_election.cc:302] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 352f709e558f4fe8b3a0546784d8df02; no voters:
I20260812 11:06:25.955274 28809 leader_election.cc:288] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:25.955380 28816 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:25.955600 28816 raft_consensus.cc:686] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [term 1 LEADER]: Becoming Leader. State: Replica: 352f709e558f4fe8b3a0546784d8df02, State: Running, Role: LEADER
I20260812 11:06:25.955922 28816 consensus_queue.cc:237] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "352f709e558f4fe8b3a0546784d8df02" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 34011 } }
I20260812 11:06:25.956519 28809 sys_catalog.cc:564] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:25.957531 28818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "352f709e558f4fe8b3a0546784d8df02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "352f709e558f4fe8b3a0546784d8df02" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 34011 } } }
I20260812 11:06:25.957665 28818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:25.958122 28819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 352f709e558f4fe8b3a0546784d8df02. Latest consensus state: current_term: 1 leader_uuid: "352f709e558f4fe8b3a0546784d8df02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "352f709e558f4fe8b3a0546784d8df02" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 34011 } } }
I20260812 11:06:25.958225 28819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02 [sys.catalog]: This master's current role is: LEADER
W20260812 11:06:25.961127 28840 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:06:25.961197 28840 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:06:25.961320 28832 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:25.962250 28832 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:25.968463 28832 catalog_manager.cc:1347] Generated new cluster ID: 4cad455eb3a14f299448232b6e6e9cee
I20260812 11:06:25.968554 28832 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:25.998080 28832 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:25.999060 28832 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:26.005162 28832 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 352f709e558f4fe8b3a0546784d8df02: Generated new TSK 0
I20260812 11:06:26.005925 28832 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 11:06:26.047423 28856 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 11:06:26.047523 28856 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 11:06:26.048215 28813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:26.024999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51896 (local address 127.18.174.254:34011)
0812 11:06:26.025137 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:26.025142 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:26.025310 (+ 168us) server_negotiation.cc:407] Connection header received
0812 11:06:26.025491 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:26.025493 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:26.025545 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:26.025650 (+ 105us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:06:26.025920 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.026445 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.027714 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.027925 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.028006 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:26.028376 (+ 370us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:06:26.047775 (+ 19399us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46515/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 11:06:26.048040 (+ 265us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51896: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46515/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 11:06:26.048285 28813 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51896: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46515/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 11:06:26.048432 28855 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:26.024858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:34011 (local address 127.0.0.1:51896)
0812 11:06:26.025216 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:26.025232 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:26.025360 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:26.025671 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:26.025675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:26.025683 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:06:26.025820 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:26.025827 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.026576 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.026580 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:26.027594 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:26.027605 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.028051 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.028055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:26.028171 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:26.028206 (+ 35us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:06:26.047995 (+ 19789us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46515/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 11:06:26.048231 (+ 236us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.174.254:34011: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46515/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":118,"threads_started":1}
I20260812 11:06:26.049144 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 28680
2026-08-12T11:06:26Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (368 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 11:06:26.105906 19131 mini_oidc.cc:152] Starting JWKS server
I20260812 11:06:26.106788 19131 webserver.cc:460] Webserver started at https://127.0.0.1:38669/ using document root <none> and password file <none>
I20260812 11:06:26.106892 19131 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 11:06:26.107162 19131 webserver.cc:460] Webserver started at http://127.0.0.1:45447/ using document root <none> and password file <none>
2026-08-12T11:06:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:26Z Disabled control of system clock
I20260812 11:06:26.116874 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:36301
--webserver_interface=127.18.174.254
--webserver_port=0
--builtin_ntp_servers=127.18.174.212:46079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:36301
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38669/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 11:06:26.231463 28865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:26.231751 28865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:26.231789 28865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:26.235885 28865 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:26.235952 28865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:26.235966 28865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:26.235985 28865 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:26.236006 28865 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:06:26.236027 28865 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:06:26.236043 28865 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38669/jwks.json
I20260812 11:06:26.240944 28865 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:36301
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:36301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38669/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:26.242089 28865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:26.243522 28865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:26.252453 28875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:26.252453 28874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:26.252548 28865 server_base.cc:1034] running on GCE node
W20260812 11:06:26.252470 28880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:26.253280 28865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:26.254482 28865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:26.255661 28865 hybrid_clock.cc:648] HybridClock initialized: now 1786532786255633 us; error 46 us; skew 500 ppm
I20260812 11:06:26.257625 28865 webserver.cc:460] Webserver started at http://127.18.174.254:44657/ using document root <none> and password file <none>
I20260812 11:06:26.258222 28865 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:26.258293 28865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:26.258494 28865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:26.260679 28865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "977f9f45823f4455827e698c1e42dcd3"
format_stamp: "Formatted at 2026-08-12 11:06:26 on dist-test-slave-lgr5"
server_key: "a846d08c8782d9e38cc27c1cee4f9622"
server_key_iv: "ca5c9a691b885f59f627615e2f8d9afd"
server_key_version: "encryptionkey@0"
I20260812 11:06:26.261269 28865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "977f9f45823f4455827e698c1e42dcd3"
format_stamp: "Formatted at 2026-08-12 11:06:26 on dist-test-slave-lgr5"
server_key: "a846d08c8782d9e38cc27c1cee4f9622"
server_key_iv: "ca5c9a691b885f59f627615e2f8d9afd"
server_key_version: "encryptionkey@0"
I20260812 11:06:26.265311 28865 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260812 11:06:26.267940 28892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:26.269387 28865 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:26.269529 28865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "977f9f45823f4455827e698c1e42dcd3"
format_stamp: "Formatted at 2026-08-12 11:06:26 on dist-test-slave-lgr5"
server_key: "a846d08c8782d9e38cc27c1cee4f9622"
server_key_iv: "ca5c9a691b885f59f627615e2f8d9afd"
server_key_version: "encryptionkey@0"
I20260812 11:06:26.269658 28865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:26.283169 28865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:26.283931 28865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:26.284168 28865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:26.293864 28865 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:36301
I20260812 11:06:26.293882 28980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:36301 every 8 connection(s)
I20260812 11:06:26.294878 28865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:26.298260 28982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:26.302747 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 28865
I20260812 11:06:26.302879 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:26.303187 19131 external_mini_cluster.cc:1428] Setting key 826cfaa6ada8f3c9a6e85636c465bc08
I20260812 11:06:26.304571 28982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3: Bootstrap starting.
I20260812 11:06:26.307049 28982 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:26.307904 28982 log.cc:824] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:26.309983 28982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3: No bootstrap required, opened a new log
I20260812 11:06:26.312927 28988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:26.304728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34736 (local address 127.18.174.254:36301)
0812 11:06:26.305448 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:26.305464 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:26.305506 (+ 42us) server_negotiation.cc:407] Connection header received
0812 11:06:26.306191 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:26.306211 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:26.306657 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:26.307011 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:26.307515 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.308607 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.309517 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.310027 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.310201 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:26.311055 (+ 854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:26.311062 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:26.311076 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:26.311505 (+ 429us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:26.311565 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:26.311587 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:26.311681 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:26.311831 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 11:06:26.312154 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":159,"threads_started":1}
I20260812 11:06:26.313866 28982 raft_consensus.cc:348] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "977f9f45823f4455827e698c1e42dcd3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36301 } }
I20260812 11:06:26.314108 28982 raft_consensus.cc:374] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:26.314167 28982 raft_consensus.cc:729] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 977f9f45823f4455827e698c1e42dcd3, State: Initialized, Role: FOLLOWER
I20260812 11:06:26.314594 28982 consensus_queue.cc:260] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "977f9f45823f4455827e698c1e42dcd3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36301 } }
I20260812 11:06:26.314728 28982 raft_consensus.cc:388] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:26.314790 28982 raft_consensus.cc:482] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:26.314888 28982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:26.315871 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:06:26.315919 28982 raft_consensus.cc:504] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "977f9f45823f4455827e698c1e42dcd3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36301 } }
I20260812 11:06:26.316319 28982 leader_election.cc:302] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 977f9f45823f4455827e698c1e42dcd3; no voters:
I20260812 11:06:26.316707 28982 leader_election.cc:288] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:26.316808 28991 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:26.317066 28991 raft_consensus.cc:686] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [term 1 LEADER]: Becoming Leader. State: Replica: 977f9f45823f4455827e698c1e42dcd3, State: Running, Role: LEADER
I20260812 11:06:26.317394 28991 consensus_queue.cc:237] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "977f9f45823f4455827e698c1e42dcd3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36301 } }
I20260812 11:06:26.318050 28982 sys_catalog.cc:564] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:26.319111 28993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "977f9f45823f4455827e698c1e42dcd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "977f9f45823f4455827e698c1e42dcd3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36301 } } }
I20260812 11:06:26.319253 28993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:26.319555 28995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 977f9f45823f4455827e698c1e42dcd3. Latest consensus state: current_term: 1 leader_uuid: "977f9f45823f4455827e698c1e42dcd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "977f9f45823f4455827e698c1e42dcd3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36301 } } }
I20260812 11:06:26.319669 28995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:26.320537 29007 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:26.323745 29007 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:26.335868 29007 catalog_manager.cc:1347] Generated new cluster ID: 47e006229fd94de0b4b5b79ac8ede82a
I20260812 11:06:26.335963 29007 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:26.374523 29007 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:26.375499 29007 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:26.384405 29007 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 977f9f45823f4455827e698c1e42dcd3: Generated new TSK 0
I20260812 11:06:26.385177 29007 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:06:26.410881 28988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:26.405579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34740 (local address 127.18.174.254:36301)
0812 11:06:26.405739 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:26.405744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:26.405958 (+ 214us) server_negotiation.cc:407] Connection header received
0812 11:06:26.406141 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:26.406145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:26.406202 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:26.406304 (+ 102us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:06:26.406588 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.407197 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.408490 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.408729 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.408816 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:26.409158 (+ 342us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:06:26.410469 (+ 1311us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38669/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 11:06:26.410745 (+ 276us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34740: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38669/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":60}
W20260812 11:06:26.410961 28988 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34740: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38669/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 11:06:26.413821 29033 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:26.405459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36301 (local address 127.0.0.1:34740)
0812 11:06:26.405837 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:26.405853 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:26.405996 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:26.406320 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:26.406324 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:26.406333 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:06:26.406471 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:26.406477 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.407341 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.407344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:26.408319 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:26.408334 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.408849 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.408853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:26.408948 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:26.408982 (+ 34us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:06:26.410661 (+ 1679us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38669/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 11:06:26.413657 (+ 2996us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.174.254:36301: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38669/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":2760,"thread_start_us":105,"threads_started":1}
I20260812 11:06:26.414482 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 28865
E20260812 11:06:26.423878 29034 webserver.cc:533] Webserver: sslize failed:
E20260812 11:06:26.423964 29034 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-12T11:06:26Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (361 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T11:06:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:26Z Disabled control of system clock
I20260812 11:06:26.477106 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:37313
--webserver_interface=127.18.174.254
--webserver_port=0
--builtin_ntp_servers=127.18.174.212:33621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:37313
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/testchainca.cert with env {}
W20260812 11:06:26.592578 29040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:26.592895 29040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:26.592954 29040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:26.597087 29040 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:26.597154 29040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:26.597175 29040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:26.597196 29040 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:26.597221 29040 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:06:26.597249 29040 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:06:26.597270 29040 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 11:06:26.602770 29040 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:33621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:37313
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:37313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:26.603885 29040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:26.604961 29040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:26.614176 29056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:26.614194 29051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:26.614176 29052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:26.614727 29040 server_base.cc:1034] running on GCE node
I20260812 11:06:26.615332 29040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:26.616650 29040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:26.617828 29040 hybrid_clock.cc:648] HybridClock initialized: now 1786532786617811 us; error 37 us; skew 500 ppm
I20260812 11:06:26.619858 29040 webserver.cc:460] Webserver started at http://127.18.174.254:33201/ using document root <none> and password file <none>
I20260812 11:06:26.620508 29040 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:26.620579 29040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:26.620795 29040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:26.622951 29040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "9e07974acb31478ebbc7c7f4d3ebca89"
format_stamp: "Formatted at 2026-08-12 11:06:26 on dist-test-slave-lgr5"
server_key: "bdbd483b77130ad9736ac2b00ca8aaad"
server_key_iv: "9da8f9bcf1439023a4b6329a05fe6932"
server_key_version: "encryptionkey@0"
I20260812 11:06:26.623523 29040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "9e07974acb31478ebbc7c7f4d3ebca89"
format_stamp: "Formatted at 2026-08-12 11:06:26 on dist-test-slave-lgr5"
server_key: "bdbd483b77130ad9736ac2b00ca8aaad"
server_key_iv: "9da8f9bcf1439023a4b6329a05fe6932"
server_key_version: "encryptionkey@0"
I20260812 11:06:26.627441 29040 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:06:26.630108 29065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:26.631376 29040 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:06:26.631495 29040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "9e07974acb31478ebbc7c7f4d3ebca89"
format_stamp: "Formatted at 2026-08-12 11:06:26 on dist-test-slave-lgr5"
server_key: "bdbd483b77130ad9736ac2b00ca8aaad"
server_key_iv: "9da8f9bcf1439023a4b6329a05fe6932"
server_key_version: "encryptionkey@0"
I20260812 11:06:26.631608 29040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:26.645622 29040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:26.646397 29040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:26.646587 29040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:26.653680 29040 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:37313
I20260812 11:06:26.653694 29183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:37313 every 8 connection(s)
I20260812 11:06:26.654735 29040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:26.658052 29184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:26.663151 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 29040
I20260812 11:06:26.663287 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:26.663589 19131 external_mini_cluster.cc:1428] Setting key 979762115d3920f35940e89a26828087
I20260812 11:06:26.664748 29184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89: Bootstrap starting.
I20260812 11:06:26.667174 29184 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:26.667982 29184 log.cc:824] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:26.669981 29184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89: No bootstrap required, opened a new log
I20260812 11:06:26.673122 29189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:26.665152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36128 (local address 127.18.174.254:37313)
0812 11:06:26.665822 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:26.665839 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:26.665878 (+ 39us) server_negotiation.cc:407] Connection header received
0812 11:06:26.666553 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:26.666572 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:26.667036 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:26.667365 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:26.667840 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.668894 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.669796 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.670317 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.670469 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:26.671326 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:26.671331 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:26.671346 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:26.671748 (+ 402us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:26.671810 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:26.671832 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:26.671930 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:26.672067 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 11:06:26.672365 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":153,"threads_started":1}
I20260812 11:06:26.673750 29184 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e07974acb31478ebbc7c7f4d3ebca89" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37313 } }
I20260812 11:06:26.673983 29184 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:26.674058 29184 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e07974acb31478ebbc7c7f4d3ebca89, State: Initialized, Role: FOLLOWER
I20260812 11:06:26.674486 29184 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e07974acb31478ebbc7c7f4d3ebca89" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37313 } }
I20260812 11:06:26.674628 29184 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:26.674692 29184 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:26.674798 29184 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:26.675892 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:06:26.675882 29184 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e07974acb31478ebbc7c7f4d3ebca89" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37313 } }
I20260812 11:06:26.676246 29184 leader_election.cc:302] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e07974acb31478ebbc7c7f4d3ebca89; no voters:
I20260812 11:06:26.676577 29184 leader_election.cc:288] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:26.676720 29196 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:26.676957 29196 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [term 1 LEADER]: Becoming Leader. State: Replica: 9e07974acb31478ebbc7c7f4d3ebca89, State: Running, Role: LEADER
I20260812 11:06:26.677335 29196 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e07974acb31478ebbc7c7f4d3ebca89" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37313 } }
I20260812 11:06:26.677901 29184 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:26.678565 29205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e07974acb31478ebbc7c7f4d3ebca89. Latest consensus state: current_term: 1 leader_uuid: "9e07974acb31478ebbc7c7f4d3ebca89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e07974acb31478ebbc7c7f4d3ebca89" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37313 } } }
I20260812 11:06:26.678723 29205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:26.679044 29199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e07974acb31478ebbc7c7f4d3ebca89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e07974acb31478ebbc7c7f4d3ebca89" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37313 } } }
I20260812 11:06:26.679167 29199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:26.679507 29220 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:26.682340 29220 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:26.688057 29220 catalog_manager.cc:1347] Generated new cluster ID: 2e85e6cbbf2e4dfb9182574cc3a9f051
I20260812 11:06:26.688163 29220 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:26.701583 29220 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:26.702934 29220 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:26.718880 29220 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e07974acb31478ebbc7c7f4d3ebca89: Generated new TSK 0
I20260812 11:06:26.719944 29220 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:06:26.781322 29189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:26.734700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36134 (local address 127.18.174.254:37313)
0812 11:06:26.734862 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:26.734867 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:26.735064 (+ 197us) server_negotiation.cc:407] Connection header received
0812 11:06:26.735250 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:26.735252 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:26.735305 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:26.735425 (+ 120us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:06:26.735685 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.736333 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.737615 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.737845 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.737937 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:26.738269 (+ 332us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:06:26.780923 (+ 42654us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 11:06:26.781203 (+ 280us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36134: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":65}
W20260812 11:06:26.781404 29189 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36134: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 11:06:26.781914 29257 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:26.734611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:37313 (local address 127.0.0.1:36134)
0812 11:06:26.734953 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:26.734978 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:26.735118 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:26.735441 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:26.735444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:26.735452 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:06:26.735578 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:26.735585 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.736460 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.736464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:26.737487 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:26.737500 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:26.737974 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:26.737978 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:26.738075 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:26.738109 (+ 34us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:06:26.781197 (+ 43088us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 11:06:26.781425 (+ 228us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.174.254:37313: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":96,"threads_started":1}
I20260812 11:06:26.782656 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 29040
2026-08-12T11:06:26Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (337 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (129 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (129 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:06:27 dist-test-slave-lgr5 krb5kdc[29283](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:06:27 dist-test-slave-lgr5 krb5kdc[29283](info): set up 2 sockets
Aug 12 11:06:27 dist-test-slave-lgr5 krb5kdc[29283](info): commencing operation
krb5kdc: starting...
W20260812 11:06:28.259284 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:06:28 dist-test-slave-lgr5 krb5kdc[29283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532788, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:06:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:06:28.387795 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:38491
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:38491
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:28.503144 29307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:28.503451 29307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:28.503495 29307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:28.507519 29307 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:28.507586 29307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:28.507604 29307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:28.507620 29307 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:28.507634 29307 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:28.513015 29307 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:38491
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:38491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:28.514083 29307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:28.515113 29307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:28.523748 29317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:28.523873 29307 server_base.cc:1034] running on GCE node
W20260812 11:06:28.523744 29322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:28.524116 29316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:28.524737 29307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:28.526064 29307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:28.527235 29307 hybrid_clock.cc:648] HybridClock initialized: now 1786532788527215 us; error 37 us; skew 500 ppm
Aug 12 11:06:28 dist-test-slave-lgr5 krb5kdc[29283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532788, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:28.533172 29307 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:06:28.534149 29307 webserver.cc:460] Webserver started at http://127.18.174.254:42629/ using document root <none> and password file <none>
I20260812 11:06:28.534713 29307 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:28.534773 29307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:28.534963 29307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:28.537209 29307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "2e0f9ff43d434edabe37c7725dd86885"
format_stamp: "Formatted at 2026-08-12 11:06:28 on dist-test-slave-lgr5"
server_key: "acfb7c76e0b98d8f209258dc47366795"
server_key_iv: "6ba30f83525bc88826d4155cc96ba6aa"
server_key_version: "encryptionkey@0"
I20260812 11:06:28.537772 29307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "2e0f9ff43d434edabe37c7725dd86885"
format_stamp: "Formatted at 2026-08-12 11:06:28 on dist-test-slave-lgr5"
server_key: "acfb7c76e0b98d8f209258dc47366795"
server_key_iv: "6ba30f83525bc88826d4155cc96ba6aa"
server_key_version: "encryptionkey@0"
I20260812 11:06:28.541661 29307 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:06:28.544241 29333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:28.545550 29307 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:28.545679 29307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "2e0f9ff43d434edabe37c7725dd86885"
format_stamp: "Formatted at 2026-08-12 11:06:28 on dist-test-slave-lgr5"
server_key: "acfb7c76e0b98d8f209258dc47366795"
server_key_iv: "6ba30f83525bc88826d4155cc96ba6aa"
server_key_version: "encryptionkey@0"
I20260812 11:06:28.545790 29307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:28.562650 29307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:28.566017 29307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:28.566220 29307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:28.573442 29307 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:38491
I20260812 11:06:28.573459 29430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:38491 every 8 connection(s)
I20260812 11:06:28.574514 29307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:28.577457 29434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:28.583436 29434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885: Bootstrap starting.
I20260812 11:06:28.584806 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 29307
I20260812 11:06:28.584933 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:28.585237 19131 external_mini_cluster.cc:1428] Setting key 86d1565cca93a7a50ab872f66d1c4dbf
I20260812 11:06:28.586196 29434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:28.587150 29434 log.cc:824] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:28.589476 29434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885: No bootstrap required, opened a new log
I20260812 11:06:28.593844 29434 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0f9ff43d434edabe37c7725dd86885" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38491 } }
I20260812 11:06:28.594110 29434 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:28.594165 29434 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e0f9ff43d434edabe37c7725dd86885, State: Initialized, Role: FOLLOWER
Aug 12 11:06:28 dist-test-slave-lgr5 krb5kdc[29283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532788, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:28.594671 29434 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0f9ff43d434edabe37c7725dd86885" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38491 } }
I20260812 11:06:28.594827 29434 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:28.594897 29434 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:28.595024 29434 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:28.596184 29434 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0f9ff43d434edabe37c7725dd86885" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38491 } }
I20260812 11:06:28.596572 29434 leader_election.cc:302] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e0f9ff43d434edabe37c7725dd86885; no voters:
I20260812 11:06:28.596891 29434 leader_election.cc:288] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:28.597007 29443 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:28.597178 29443 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [term 1 LEADER]: Becoming Leader. State: Replica: 2e0f9ff43d434edabe37c7725dd86885, State: Running, Role: LEADER
I20260812 11:06:28.597581 29443 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0f9ff43d434edabe37c7725dd86885" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38491 } }
I20260812 11:06:28.598356 29434 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:28.599315 29444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e0f9ff43d434edabe37c7725dd86885" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0f9ff43d434edabe37c7725dd86885" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38491 } } }
I20260812 11:06:28.599454 29444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:28.599722 29446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e0f9ff43d434edabe37c7725dd86885. Latest consensus state: current_term: 1 leader_uuid: "2e0f9ff43d434edabe37c7725dd86885" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0f9ff43d434edabe37c7725dd86885" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38491 } } }
I20260812 11:06:28.599852 29446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:28.601222 29438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:28.586444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49800 (local address 127.18.174.254:38491)
0812 11:06:28.586887 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:28.586909 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:28.586953 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:06:28.587772 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:28.587794 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:28.588230 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:28.588613 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:28.589293 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:28.590771 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:28.591618 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:28.592435 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:28.592633 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:28.595248 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:28.595254 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:28.595271 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:28.595313 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:28.597243 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:28.597810 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:28.597817 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:28.597824 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:28.597947 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:28.598261 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:28.598265 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:28.598267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:28.598791 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:28.598984 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:28.599804 (+ 820us) server_negotiation.cc:299] Negotiation successful
0812 11:06:28.600166 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":125,"threads_started":1}
W20260812 11:06:28.603855 29462 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:06:28.603948 29462 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:06:28.604097 29454 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:28.604846 29454 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:28.611006 29454 catalog_manager.cc:1347] Generated new cluster ID: d28dd73568694ea09ac3897820f7f12b
I20260812 11:06:28.611100 29454 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:28.630786 29454 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:28.632246 29454 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:28.647044 29454 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e0f9ff43d434edabe37c7725dd86885: Generated new TSK 0
I20260812 11:06:28.648026 29454 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:06:28.681362 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:38491
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:28.797111 29473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:28.797456 29473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:28.797511 29473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:28.801805 29473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:28.801882 29473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:28.801941 29473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:28.807391 29473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:38491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:28.808557 29473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:28.809571 29473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:28.819577 29485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:28.819577 29480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:28.819578 29479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:28.819936 29473 server_base.cc:1034] running on GCE node
I20260812 11:06:28.820556 29473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:28.821250 29473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:28.822448 29473 hybrid_clock.cc:648] HybridClock initialized: now 1786532788822414 us; error 44 us; skew 500 ppm
Aug 12 11:06:28 dist-test-slave-lgr5 krb5kdc[29283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532788, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:28.825464 29473 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:06:28.826419 29473 webserver.cc:460] Webserver started at http://127.18.174.193:42483/ using document root <none> and password file <none>
I20260812 11:06:28.826992 29473 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:28.827061 29473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:28.827282 29473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:28.829553 29473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "85f006f0e2c74e1f8d3eb5ffea4a2de8"
format_stamp: "Formatted at 2026-08-12 11:06:28 on dist-test-slave-lgr5"
server_key: "0b0602862fdd7453532f61c68e6c0ed9"
server_key_iv: "8ece4b02638cae6b1d0a6d7a35aa717f"
server_key_version: "encryptionkey@0"
I20260812 11:06:28.830111 29473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "85f006f0e2c74e1f8d3eb5ffea4a2de8"
format_stamp: "Formatted at 2026-08-12 11:06:28 on dist-test-slave-lgr5"
server_key: "0b0602862fdd7453532f61c68e6c0ed9"
server_key_iv: "8ece4b02638cae6b1d0a6d7a35aa717f"
server_key_version: "encryptionkey@0"
I20260812 11:06:28.833976 29473 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:06:28.836678 29499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:28.837937 29473 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:28.838069 29473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "85f006f0e2c74e1f8d3eb5ffea4a2de8"
format_stamp: "Formatted at 2026-08-12 11:06:28 on dist-test-slave-lgr5"
server_key: "0b0602862fdd7453532f61c68e6c0ed9"
server_key_iv: "8ece4b02638cae6b1d0a6d7a35aa717f"
server_key_version: "encryptionkey@0"
I20260812 11:06:28.838179 29473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:28.852501 29473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:28.855722 29473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:28.855919 29473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:28.856608 29473 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:28.857504 29473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:28.857553 29473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:28.857611 29473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:28.857637 29473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:28.866357 29473 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:35523
I20260812 11:06:28.866384 29715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:35523 every 8 connection(s)
I20260812 11:06:28.867352 29473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:06:28.868623 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 29473
I20260812 11:06:28.868726 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:06:28.869017 19131 external_mini_cluster.cc:1428] Setting key 212c28ac05f75e7979054beca44624f3
Aug 12 11:06:28 dist-test-slave-lgr5 krb5kdc[29283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532788, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
I20260812 11:06:28.882776 29438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:28.869436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:34871 (local address 127.18.174.254:38491)
0812 11:06:28.869577 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:28.869581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:28.870781 (+ 1200us) server_negotiation.cc:407] Connection header received
0812 11:06:28.872562 (+ 1781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:28.872565 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:28.872615 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:28.872710 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:28.874005 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:28.874765 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:28.876020 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:28.876400 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:28.876529 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:28.879292 (+ 2763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:28.879296 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:28.879299 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:28.879331 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:28.880702 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:28.881182 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:28.881184 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:28.881185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:28.881256 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:28.881611 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:28.881613 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:28.881615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:28.881796 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:28.881863 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:28.882526 (+ 663us) server_negotiation.cc:299] Negotiation successful
0812 11:06:28.882645 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:06:28.883903 29718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:28.869964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:38491 (local address 127.18.174.193:34871)
0812 11:06:28.870605 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:28.870671 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:28.872315 (+ 1644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:28.872925 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:28.872932 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:28.873320 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:28.873849 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:28.873865 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:28.874880 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:28.874883 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:28.875883 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:28.875894 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:28.876576 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:28.876580 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:28.876746 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:28.877410 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:28.877427 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:28.879089 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:28.880819 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:28.880824 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:28.880840 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:28.881105 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:28.881346 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:28.881348 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:28.881350 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:28.881528 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:28.881888 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:28.881893 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:28.882229 (+ 336us) client_negotiation.cc:769] Sending connection context
0812 11:06:28.882450 (+ 221us) client_negotiation.cc:240] Negotiation successful
0812 11:06:28.882824 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":159,"threads_started":1}
I20260812 11:06:28.885234 29716 heartbeater.cc:347] Connected to a master server at 127.18.174.254:38491
I20260812 11:06:28.885516 29716 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:28.886026 29716 heartbeater.cc:511] Master 127.18.174.254:38491 requested a full tablet report, sending...
I20260812 11:06:28.887712 29359 ts_manager.cc:194] Registered new tserver with Master: 85f006f0e2c74e1f8d3eb5ffea4a2de8 (127.18.174.193:35523)
I20260812 11:06:28.889358 29359 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:34871
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:06:28.899439 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:38491
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:29.014269 29723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:29.014554 29723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:29.014616 29723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:29.018906 29723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:29.018977 29723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:29.019058 29723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:06:29.024401 29723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:38491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:29.025501 29723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:29.026521 29723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:29.036284 29733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:29.036347 29723 server_base.cc:1034] running on GCE node
W20260812 11:06:29.036288 29731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:29.036571 29735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:29.036991 29723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:29.037637 29723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:29.038795 29723 hybrid_clock.cc:648] HybridClock initialized: now 1786532789038774 us; error 33 us; skew 500 ppm
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[29283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532789, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:29.041596 29723 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:06:29.042551 29723 webserver.cc:460] Webserver started at http://127.18.174.194:41915/ using document root <none> and password file <none>
I20260812 11:06:29.043114 29723 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:29.043177 29723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:29.043368 29723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:29.045563 29723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "fd24b0156fcb490d92d6bfd41c7b2ac0"
format_stamp: "Formatted at 2026-08-12 11:06:29 on dist-test-slave-lgr5"
server_key: "e92410676cbdecfd9493a721a98623af"
server_key_iv: "663b8dca5098b095a95c9f3e7cdb1fec"
server_key_version: "encryptionkey@0"
I20260812 11:06:29.046165 29723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "fd24b0156fcb490d92d6bfd41c7b2ac0"
format_stamp: "Formatted at 2026-08-12 11:06:29 on dist-test-slave-lgr5"
server_key: "e92410676cbdecfd9493a721a98623af"
server_key_iv: "663b8dca5098b095a95c9f3e7cdb1fec"
server_key_version: "encryptionkey@0"
I20260812 11:06:29.050066 29723 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:06:29.052639 29749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:29.053929 29723 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:29.054040 29723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "fd24b0156fcb490d92d6bfd41c7b2ac0"
format_stamp: "Formatted at 2026-08-12 11:06:29 on dist-test-slave-lgr5"
server_key: "e92410676cbdecfd9493a721a98623af"
server_key_iv: "663b8dca5098b095a95c9f3e7cdb1fec"
server_key_version: "encryptionkey@0"
I20260812 11:06:29.054152 29723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:29.073371 29723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:29.076598 29723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:29.076781 29723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:29.077389 29723 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:29.078269 29723 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:29.078315 29723 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:29.078359 29723 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:29.078387 29723 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:29.087085 29723 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:44387
I20260812 11:06:29.087123 29955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:44387 every 8 connection(s)
I20260812 11:06:29.088023 29723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:06:29.096706 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 29723
I20260812 11:06:29.096817 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:06:29.097108 19131 external_mini_cluster.cc:1428] Setting key c30e3a4d4697c6d7beb98d0b83ac0985
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[29283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532789, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:29.102643 29438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:29.089918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:48151 (local address 127.18.174.254:38491)
0812 11:06:29.090069 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:29.090073 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:29.090914 (+ 841us) server_negotiation.cc:407] Connection header received
0812 11:06:29.092357 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:29.092360 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:29.092419 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:29.092493 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:29.093790 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:29.094327 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:29.095490 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:29.095708 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:29.095814 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:29.098336 (+ 2522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:29.098340 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:29.098342 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:29.098370 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:29.100126 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:29.100690 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:29.100694 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:29.100696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:29.100800 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:29.101202 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:29.101207 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:29.101209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:29.101456 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:29.101697 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:29.102368 (+ 671us) server_negotiation.cc:299] Negotiation successful
0812 11:06:29.102516 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:06:29.103739 29960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:29.090302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:38491 (local address 127.18.174.194:48151)
0812 11:06:29.090768 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:29.090812 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:29.092145 (+ 1333us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:29.092709 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:29.092719 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:29.093084 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:29.093637 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:29.093652 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:29.094454 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:29.094457 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:29.095358 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:29.095369 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:29.095857 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:29.095861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:29.096036 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:29.096611 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:29.096628 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:29.098177 (+ 1549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:29.100235 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:29.100241 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:29.100259 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:29.100559 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:29.100910 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:29.100913 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:29.100915 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:29.101094 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:29.101703 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:29.101710 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:29.102064 (+ 354us) client_negotiation.cc:769] Sending connection context
0812 11:06:29.102284 (+ 220us) client_negotiation.cc:240] Negotiation successful
0812 11:06:29.102652 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":120,"threads_started":1}
I20260812 11:06:29.105047 29957 heartbeater.cc:347] Connected to a master server at 127.18.174.254:38491
I20260812 11:06:29.105301 29957 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:29.105832 29957 heartbeater.cc:511] Master 127.18.174.254:38491 requested a full tablet report, sending...
I20260812 11:06:29.106933 29359 ts_manager.cc:194] Registered new tserver with Master: fd24b0156fcb490d92d6bfd41c7b2ac0 (127.18.174.194:44387)
I20260812 11:06:29.107513 29359 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:48151
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:06:29.127311 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:38491
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:29.244411 29968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:29.244686 29968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:29.244748 29968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:29.248795 29968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:29.248860 29968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:29.248939 29968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:06:29.254451 29968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:38491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:29.255568 29968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:29.256660 29968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:29.266782 29982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:29.266786 29985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:29.266858 29968 server_base.cc:1034] running on GCE node
W20260812 11:06:29.266786 29981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:29.267459 29968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:29.268147 29968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:29.269366 29968 hybrid_clock.cc:648] HybridClock initialized: now 1786532789269346 us; error 35 us; skew 500 ppm
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[29283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532789, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:29.272331 29968 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:06:29.273269 29968 webserver.cc:460] Webserver started at http://127.18.174.195:38531/ using document root <none> and password file <none>
I20260812 11:06:29.273867 29968 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:29.273939 29968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:29.274158 29968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:29.276382 29968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "2a1b349cb95e4bbcaee98ca795b29b7c"
format_stamp: "Formatted at 2026-08-12 11:06:29 on dist-test-slave-lgr5"
server_key: "4f1ad4eb03dda817ea46af27ebe09e09"
server_key_iv: "7bc746955d511881c7b22ed6feeae7b2"
server_key_version: "encryptionkey@0"
I20260812 11:06:29.276994 29968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "2a1b349cb95e4bbcaee98ca795b29b7c"
format_stamp: "Formatted at 2026-08-12 11:06:29 on dist-test-slave-lgr5"
server_key: "4f1ad4eb03dda817ea46af27ebe09e09"
server_key_iv: "7bc746955d511881c7b22ed6feeae7b2"
server_key_version: "encryptionkey@0"
I20260812 11:06:29.281111 29968 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:06:29.283866 30001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:29.285213 29968 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:06:29.285343 29968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "2a1b349cb95e4bbcaee98ca795b29b7c"
format_stamp: "Formatted at 2026-08-12 11:06:29 on dist-test-slave-lgr5"
server_key: "4f1ad4eb03dda817ea46af27ebe09e09"
server_key_iv: "7bc746955d511881c7b22ed6feeae7b2"
server_key_version: "encryptionkey@0"
I20260812 11:06:29.285461 29968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:29.318005 29968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:29.321437 29968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:29.321617 29968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:29.322219 29968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:29.323074 29968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:29.323122 29968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:29.323168 29968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:29.323197 29968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:29.331871 29968 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:46737
I20260812 11:06:29.331905 30216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:46737 every 8 connection(s)
I20260812 11:06:29.332827 29968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:06:29.334520 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 29968
I20260812 11:06:29.334631 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:06:29.334966 19131 external_mini_cluster.cc:1428] Setting key 6530fec129f7823dc06c850dc1cab423
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[29283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532789, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:29.346427 29438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:29.334805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:60117 (local address 127.18.174.254:38491)
0812 11:06:29.334960 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:29.334965 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:29.335966 (+ 1001us) server_negotiation.cc:407] Connection header received
0812 11:06:29.337512 (+ 1546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:29.337514 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:29.337562 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:29.337629 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:29.338817 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:29.339376 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:29.340567 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:29.340805 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:29.340890 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:29.343363 (+ 2473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:29.343367 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:29.343369 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:29.343394 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:29.344608 (+ 1214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:29.345076 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:29.345078 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:29.345079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:29.345153 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:29.345428 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:29.345430 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:29.345431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:29.345618 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:29.345691 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:29.346205 (+ 514us) server_negotiation.cc:299] Negotiation successful
0812 11:06:29.346301 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:06:29.347327 30221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:29.335255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:38491 (local address 127.18.174.195:60117)
0812 11:06:29.335821 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:29.335881 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:29.337320 (+ 1439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:29.337785 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:29.337793 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:29.338155 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:29.338672 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:29.338686 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:29.339497 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:29.339500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:29.340434 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:29.340443 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:29.340931 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:29.340933 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:29.341102 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:29.341715 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:29.341732 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:29.343204 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:29.344721 (+ 1517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:29.344726 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:29.344739 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:29.344995 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:29.345221 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:29.345223 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:29.345224 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:29.345359 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:29.345738 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:29.345744 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:29.346008 (+ 264us) client_negotiation.cc:769] Sending connection context
0812 11:06:29.346177 (+ 169us) client_negotiation.cc:240] Negotiation successful
0812 11:06:29.346447 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":151,"threads_started":1}
I20260812 11:06:29.348490 30217 heartbeater.cc:347] Connected to a master server at 127.18.174.254:38491
I20260812 11:06:29.348734 30217 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:29.349248 30217 heartbeater.cc:511] Master 127.18.174.254:38491 requested a full tablet report, sending...
I20260812 11:06:29.350322 29358 ts_manager.cc:194] Registered new tserver with Master: 2a1b349cb95e4bbcaee98ca795b29b7c (127.18.174.195:46737)
I20260812 11:06:29.350903 29358 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:60117
I20260812 11:06:29.360916 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/test-admin.keytab.
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[29283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:29.379118 19131 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 11:06:29.382156 30235 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:29.380728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53314 (local address 127.18.174.193:35523)
0812 11:06:29.381065 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:29.381081 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:29.381106 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:06:29.381162 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:29.381168 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:29.381364 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:29.381501 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:29.381993 (+ 492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53314: BlockingRecv error: recv got EOF from 127.0.0.1:53314 (error 108)
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":124,"threads_started":1}
W20260812 11:06:29.382584 19131 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/krb5cc' of type FILE
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[29283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:29.383683 19131 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[29283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:29.384706 19131 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[29283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.193@KRBTEST.COM
I20260812 11:06:29.394836 30235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:29.385749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53324 (local address 127.18.174.193:35523)
0812 11:06:29.385881 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:29.385884 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:29.385946 (+ 62us) server_negotiation.cc:407] Connection header received
0812 11:06:29.386103 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:29.386106 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:29.386153 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:29.386224 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:29.386792 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:29.387554 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:29.388526 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:29.388922 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:29.389018 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:29.391475 (+ 2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:29.391488 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:29.391504 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:29.391533 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:29.393167 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:29.393566 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:29.393571 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:29.393572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:29.393666 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:29.393930 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:29.393933 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:29.393934 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:29.394198 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:29.394370 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:29.394520 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 11:06:29.394678 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 11:06:29.398588 30235 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:29.397706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53328 (local address 127.18.174.193:35523)
0812 11:06:29.397844 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:29.397848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:29.397917 (+ 69us) server_negotiation.cc:407] Connection header received
0812 11:06:29.398016 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:29.398018 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:29.398055 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:29.398117 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:29.398464 (+ 347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53328: BlockingRecv error: recv got EOF from 127.0.0.1:53328 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260812 11:06:29.398797 19131 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/krb5cc' of type FILE
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[29283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:29.399873 19131 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[29283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:29.400817 19131 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[29283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.193@KRBTEST.COM
I20260812 11:06:29.409214 30235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:29.401682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53340 (local address 127.18.174.193:35523)
0812 11:06:29.401827 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:29.401830 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:29.401846 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:06:29.401979 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:29.401981 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:29.402020 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:29.402078 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:29.402520 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:29.403024 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:29.403745 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:29.403972 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:29.404041 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:29.406261 (+ 2220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:29.406265 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:29.406267 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:29.406294 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:29.407593 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:29.408010 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:29.408013 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:29.408014 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:29.408144 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:29.408403 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:29.408407 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:29.408408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:29.408585 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:29.408707 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:29.408942 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 11:06:29.409056 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260812 11:06:29.411993 30235 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:29.411032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53356 (local address 127.18.174.193:35523)
0812 11:06:29.411157 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:29.411160 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:29.411235 (+ 75us) server_negotiation.cc:407] Connection header received
0812 11:06:29.411360 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:29.411363 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:29.411406 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:29.411469 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:29.411883 (+ 414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53356: BlockingRecv error: recv got EOF from 127.0.0.1:53356 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260812 11:06:29.412377 19131 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532756485707-19131-0/krb5kdc/krb5cc)
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[29283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:29.413378 19131 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[29283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:29.414211 19131 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[29283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.193@KRBTEST.COM
I20260812 11:06:29.422578 30235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:29.415079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53366 (local address 127.18.174.193:35523)
0812 11:06:29.415195 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:29.415198 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:29.415288 (+ 90us) server_negotiation.cc:407] Connection header received
0812 11:06:29.415389 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:29.415391 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:29.415430 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:29.415499 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:29.416011 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:29.416616 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:29.417451 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:29.417676 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:29.417764 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:29.419939 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:29.419943 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:29.419945 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:29.419982 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:29.421339 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:29.421676 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:29.421678 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:29.421679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:29.421748 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:29.421927 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:29.421929 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:29.421930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:29.422103 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:29.422209 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:29.422357 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 11:06:29.422449 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:06:29.423740 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 29473
I20260812 11:06:29.440047 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 29723
I20260812 11:06:29.457059 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 29968
I20260812 11:06:29.504720 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 29307
2026-08-12T11:06:29Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2472 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[30256](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[30256](info): set up 2 sockets
Aug 12 11:06:29 dist-test-slave-lgr5 krb5kdc[30256](info): commencing operation
krb5kdc: starting...
W20260812 11:06:30.716037 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:06:30 dist-test-slave-lgr5 krb5kdc[30256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:06:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:30Z Disabled control of system clock
WARNING: no policy specified for oryx/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.254.keytab.
Entry for principal oryx/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.254.keytab.
I20260812 11:06:30.843485 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:36209
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.254.keytab
--principal=oryx/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:42161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:36209
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:30.958055 30286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:30.958357 30286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:30.958416 30286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:30.962543 30286 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:30.962620 30286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:30.962648 30286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:30.962669 30286 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:30.962690 30286 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:30.968310 30286 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:42161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:36209
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.254.keytab
--principal=oryx/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:36209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:30.969482 30286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:30.970563 30286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:30.979506 30300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:30.979503 30296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:30.979564 30286 server_base.cc:1034] running on GCE node
W20260812 11:06:30.979503 30297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:30.980444 30286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:30.981662 30286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:30.982831 30286 hybrid_clock.cc:648] HybridClock initialized: now 1786532790982812 us; error 34 us; skew 500 ppm
Aug 12 11:06:30 dist-test-slave-lgr5 krb5kdc[30256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532790, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:30.985632 30286 init.cc:377] Logged in from keytab as oryx/127.18.174.254@KRBTEST.COM (short username oryx)
I20260812 11:06:30.986656 30286 webserver.cc:460] Webserver started at http://127.18.174.254:41957/ using document root <none> and password file <none>
I20260812 11:06:30.987250 30286 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:30.987324 30286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:30.987558 30286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:30.989910 30286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "62f6c8a5610b47bb87260c44b13fe041"
format_stamp: "Formatted at 2026-08-12 11:06:30 on dist-test-slave-lgr5"
server_key: "841e3704d0277ae18b97dcf602980788"
server_key_iv: "e681d229656d9b98a2f76ce3185ce2b0"
server_key_version: "encryptionkey@0"
I20260812 11:06:30.990523 30286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "62f6c8a5610b47bb87260c44b13fe041"
format_stamp: "Formatted at 2026-08-12 11:06:30 on dist-test-slave-lgr5"
server_key: "841e3704d0277ae18b97dcf602980788"
server_key_iv: "e681d229656d9b98a2f76ce3185ce2b0"
server_key_version: "encryptionkey@0"
I20260812 11:06:30.994490 30286 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:06:30.997058 30307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:30.998334 30286 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:30.998461 30286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "62f6c8a5610b47bb87260c44b13fe041"
format_stamp: "Formatted at 2026-08-12 11:06:30 on dist-test-slave-lgr5"
server_key: "841e3704d0277ae18b97dcf602980788"
server_key_iv: "e681d229656d9b98a2f76ce3185ce2b0"
server_key_version: "encryptionkey@0"
I20260812 11:06:30.998572 30286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:31.011293 30286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:31.014331 30286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:31.014530 30286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:31.021677 30286 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:36209
I20260812 11:06:31.021935 30394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:36209 every 8 connection(s)
I20260812 11:06:31.022697 30286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:31.025605 30396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:31.030728 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 30286
I20260812 11:06:31.030874 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:31.031184 19131 external_mini_cluster.cc:1428] Setting key ae341d2efa0d50cba1bdf6dc28b22da2
I20260812 11:06:31.031678 30396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041: Bootstrap starting.
I20260812 11:06:31.034188 30396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:31.034950 30396 log.cc:824] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:31.036979 30396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041: No bootstrap required, opened a new log
Aug 12 11:06:31 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
I20260812 11:06:31.040967 30396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } }
I20260812 11:06:31.041278 30396 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:31.041340 30396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62f6c8a5610b47bb87260c44b13fe041, State: Initialized, Role: FOLLOWER
I20260812 11:06:31.041858 30396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } }
I20260812 11:06:31.042029 30396 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:31.042114 30396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:31.042214 30396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:31.043324 30396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } }
I20260812 11:06:31.043735 30396 leader_election.cc:302] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62f6c8a5610b47bb87260c44b13fe041; no voters:
I20260812 11:06:31.044109 30396 leader_election.cc:288] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:31.044226 30403 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:31.044478 30403 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [term 1 LEADER]: Becoming Leader. State: Replica: 62f6c8a5610b47bb87260c44b13fe041, State: Running, Role: LEADER
I20260812 11:06:31.044869 30403 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } }
I20260812 11:06:31.045526 30396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:31.046216 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:31.032620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42684 (local address 127.18.174.254:36209)
0812 11:06:31.033051 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:31.033067 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:31.033103 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:06:31.033767 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:31.033786 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:31.034137 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:31.034492 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:31.035308 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:31.036399 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:31.037279 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:31.037822 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:31.037980 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:31.040643 (+ 2663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:31.040649 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:31.040664 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:31.040694 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:31.042688 (+ 1994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:31.043113 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:31.043120 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:31.043126 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:31.043283 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:31.043573 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:31.043576 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:31.043578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:31.044182 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:31.044374 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:31.044810 (+ 436us) server_negotiation.cc:299] Negotiation successful
0812 11:06:31.045149 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":136,"threads_started":1}
I20260812 11:06:31.046811 30406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62f6c8a5610b47bb87260c44b13fe041. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } }
I20260812 11:06:31.046944 30406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:31.047284 30405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } }
I20260812 11:06:31.047359 30405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:31.047345 30422 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:31.052201 30422 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:31.057857 30422 catalog_manager.cc:1347] Generated new cluster ID: 50ee3a6bda774d0fad714ef7f751cf36
I20260812 11:06:31.057942 30422 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:31.072760 30422 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:31.074153 30422 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:31.080905 30422 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041: Generated new TSK 0
I20260812 11:06:31.081807 30422 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.193.keytab.
Entry for principal oryx/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.193.keytab.
I20260812 11:06:31.119277 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36209
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.193.keytab
--principal=oryx/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:42161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:31.235430 30443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:31.235728 30443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:31.235791 30443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:31.239955 30443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:31.240034 30443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:31.240137 30443 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:31.245638 30443 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:42161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.193.keytab
--principal=oryx/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30443
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:31.246846 30443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:31.247943 30443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:31.257840 30458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:31.257898 30443 server_base.cc:1034] running on GCE node
W20260812 11:06:31.257840 30453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:31.257911 30452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:31.258512 30443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:31.259173 30443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:31.260324 30443 hybrid_clock.cc:648] HybridClock initialized: now 1786532791260285 us; error 59 us; skew 500 ppm
Aug 12 11:06:31 dist-test-slave-lgr5 krb5kdc[30256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532791, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:31.263092 30443 init.cc:377] Logged in from keytab as oryx/127.18.174.193@KRBTEST.COM (short username oryx)
I20260812 11:06:31.264035 30443 webserver.cc:460] Webserver started at http://127.18.174.193:41803/ using document root <none> and password file <none>
I20260812 11:06:31.264649 30443 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:31.264714 30443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:31.264899 30443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:31.267304 30443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "4721022f36a84a28b9502b8310486068"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "68a6b5cc84aebc93dc595ab578c60596"
server_key_iv: "b91badc066b1459328b15f9f7ce95225"
server_key_version: "encryptionkey@0"
I20260812 11:06:31.267886 30443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "4721022f36a84a28b9502b8310486068"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "68a6b5cc84aebc93dc595ab578c60596"
server_key_iv: "b91badc066b1459328b15f9f7ce95225"
server_key_version: "encryptionkey@0"
I20260812 11:06:31.271965 30443 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:06:31.274459 30471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:31.275743 30443 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:06:31.275851 30443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "4721022f36a84a28b9502b8310486068"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "68a6b5cc84aebc93dc595ab578c60596"
server_key_iv: "b91badc066b1459328b15f9f7ce95225"
server_key_version: "encryptionkey@0"
I20260812 11:06:31.275945 30443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:31.289013 30443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:31.292528 30443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:31.292763 30443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:31.293438 30443 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:31.294420 30443 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:31.294478 30443 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:31.294543 30443 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:31.294574 30443 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:31.304375 30443 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:34803
I20260812 11:06:31.304395 30678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:34803 every 8 connection(s)
I20260812 11:06:31.305408 30443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:06:31.306946 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 30443
I20260812 11:06:31.307085 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:06:31.307428 19131 external_mini_cluster.cc:1428] Setting key 428c9fe6ae8496b9f673709f52ec2fbc
Aug 12 11:06:31 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532791, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.18.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.174.194@KRBTEST.COM" created.
I20260812 11:06:31.319545 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:31.307499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:33349 (local address 127.18.174.254:36209)
0812 11:06:31.307950 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:31.307955 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:31.308790 (+ 835us) server_negotiation.cc:407] Connection header received
0812 11:06:31.310290 (+ 1500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:31.310294 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:31.310348 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:31.310421 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:31.311657 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:31.312230 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:31.313412 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:31.313652 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:31.313741 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:31.316395 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:31.316399 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:31.316401 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:31.316426 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:31.317713 (+ 1287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:31.318204 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:31.318206 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:31.318208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:31.318284 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:31.318551 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:31.318553 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:31.318554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:31.318725 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:31.318800 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:31.319271 (+ 471us) server_negotiation.cc:299] Negotiation successful
0812 11:06:31.319393 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343}
I20260812 11:06:31.320475 30685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:31.308057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.193:33349)
0812 11:06:31.308628 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:31.308691 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:31.310068 (+ 1377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:31.310617 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:31.310625 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:31.311000 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:31.311508 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:31.311523 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:31.312349 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:31.312353 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:31.313298 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:31.313309 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:31.313797 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:31.313802 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:31.313974 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:31.314554 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:31.314571 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:31.316216 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:31.317829 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:31.317834 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:31.317847 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:31.318118 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:31.318352 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:31.318354 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:31.318356 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:31.318486 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:31.318795 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:31.318800 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:31.319054 (+ 254us) client_negotiation.cc:769] Sending connection context
0812 11:06:31.319208 (+ 154us) client_negotiation.cc:240] Negotiation successful
0812 11:06:31.319498 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":119,"threads_started":1}
I20260812 11:06:31.321755 30680 heartbeater.cc:347] Connected to a master server at 127.18.174.254:36209
I20260812 11:06:31.322045 30680 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:31.322676 30680 heartbeater.cc:511] Master 127.18.174.254:36209 requested a full tablet report, sending...
I20260812 11:06:31.324307 30335 ts_manager.cc:194] Registered new tserver with Master: 4721022f36a84a28b9502b8310486068 (127.18.174.193:34803)
I20260812 11:06:31.325452 30335 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:33349
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.194.keytab.
Entry for principal oryx/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.194.keytab.
I20260812 11:06:31.335893 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36209
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.194.keytab
--principal=oryx/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:42161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:31.452540 30690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:31.452828 30690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:31.452875 30690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:31.456972 30690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:31.457037 30690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:31.457096 30690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:06:31.462513 30690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:42161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.194.keytab
--principal=oryx/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:31.463636 30690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:31.464684 30690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:31.474644 30703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:31.474653 30701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:31.474644 30706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:31.474881 30690 server_base.cc:1034] running on GCE node
I20260812 11:06:31.475402 30690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:31.476071 30690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:31.477265 30690 hybrid_clock.cc:648] HybridClock initialized: now 1786532791477234 us; error 43 us; skew 500 ppm
Aug 12 11:06:31 dist-test-slave-lgr5 krb5kdc[30256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532791, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:31.480232 30690 init.cc:377] Logged in from keytab as oryx/127.18.174.194@KRBTEST.COM (short username oryx)
I20260812 11:06:31.481227 30690 webserver.cc:460] Webserver started at http://127.18.174.194:39095/ using document root <none> and password file <none>
I20260812 11:06:31.481814 30690 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:31.481885 30690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:31.482113 30690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:31.484521 30690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "08e884e163254639b724b04debf66e1c"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "d61d516515f149317d1befc2ae40b6a7"
server_key_iv: "4045b545ebe5992e23b04c829a6adca4"
server_key_version: "encryptionkey@0"
I20260812 11:06:31.485144 30690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "08e884e163254639b724b04debf66e1c"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "d61d516515f149317d1befc2ae40b6a7"
server_key_iv: "4045b545ebe5992e23b04c829a6adca4"
server_key_version: "encryptionkey@0"
I20260812 11:06:31.489140 30690 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:06:31.491719 30728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:31.493058 30690 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:31.493196 30690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "08e884e163254639b724b04debf66e1c"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "d61d516515f149317d1befc2ae40b6a7"
server_key_iv: "4045b545ebe5992e23b04c829a6adca4"
server_key_version: "encryptionkey@0"
I20260812 11:06:31.493307 30690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:31.507596 30690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:31.510943 30690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:31.511142 30690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:31.511775 30690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:31.512696 30690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:31.512763 30690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:31.512820 30690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:31.512848 30690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:31.521555 30690 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:44457
I20260812 11:06:31.521602 30932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:44457 every 8 connection(s)
I20260812 11:06:31.522504 30690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:06:31.523193 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 30690
I20260812 11:06:31.523324 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:06:31.523650 19131 external_mini_cluster.cc:1428] Setting key fc377b4f3fdb631b5731c5e8846a9c8d
Aug 12 11:06:31 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532791, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.18.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.174.195@KRBTEST.COM" created.
I20260812 11:06:31.538350 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:31.524570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:45641 (local address 127.18.174.254:36209)
0812 11:06:31.524713 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:31.524718 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:31.525806 (+ 1088us) server_negotiation.cc:407] Connection header received
0812 11:06:31.527564 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:31.527568 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:31.527631 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:31.527727 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:31.529144 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:31.529687 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:31.531428 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:31.531661 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:31.531748 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:31.534723 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:31.534727 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:31.534730 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:31.534762 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:31.536190 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:31.536682 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:31.536685 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:31.536686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:31.536799 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:31.537107 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:31.537109 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:31.537110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:31.537311 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:31.537428 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:31.538053 (+ 625us) server_negotiation.cc:299] Negotiation successful
0812 11:06:31.538191 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:06:31.539165 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:31.525009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.194:45641)
0812 11:06:31.525617 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:31.525683 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:31.527281 (+ 1598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:31.527901 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:31.527908 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:31.528359 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:31.528976 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:31.528998 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:31.529823 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:31.529826 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:31.531278 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:31.531292 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:31.531833 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:31.531837 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:31.532065 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:31.532722 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:31.532743 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:31.534513 (+ 1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:31.536294 (+ 1781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:31.536300 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:31.536314 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:31.536593 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:31.536893 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:31.536895 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:31.536896 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:31.537035 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:31.537401 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:31.537408 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:31.537777 (+ 369us) client_negotiation.cc:769] Sending connection context
0812 11:06:31.537975 (+ 198us) client_negotiation.cc:240] Negotiation successful
0812 11:06:31.538261 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":164,"threads_started":1}
I20260812 11:06:31.540452 30934 heartbeater.cc:347] Connected to a master server at 127.18.174.254:36209
I20260812 11:06:31.540705 30934 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:31.541227 30934 heartbeater.cc:511] Master 127.18.174.254:36209 requested a full tablet report, sending...
I20260812 11:06:31.542348 30335 ts_manager.cc:194] Registered new tserver with Master: 08e884e163254639b724b04debf66e1c (127.18.174.194:44457)
I20260812 11:06:31.543097 30335 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:45641
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.195.keytab.
Entry for principal oryx/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.195.keytab.
I20260812 11:06:31.555099 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36209
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.195.keytab
--principal=oryx/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:42161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:31.673230 30942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:31.673517 30942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:31.673578 30942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:31.677630 30942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:31.677699 30942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:31.677780 30942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:06:31.683369 30942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:42161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.195.keytab
--principal=oryx/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:31.684527 30942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:31.685562 30942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:31.695192 30949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:31.695235 30948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:31.695222 30951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:31.695307 30942 server_base.cc:1034] running on GCE node
I20260812 11:06:31.695912 30942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:31.696664 30942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:31.697821 30942 hybrid_clock.cc:648] HybridClock initialized: now 1786532791697805 us; error 27 us; skew 500 ppm
Aug 12 11:06:31 dist-test-slave-lgr5 krb5kdc[30256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532791, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:31.700613 30942 init.cc:377] Logged in from keytab as oryx/127.18.174.195@KRBTEST.COM (short username oryx)
I20260812 11:06:31.701450 30942 webserver.cc:460] Webserver started at http://127.18.174.195:34783/ using document root <none> and password file <none>
I20260812 11:06:31.702023 30942 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:31.702088 30942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:31.702262 30942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:31.704440 30942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "4141b201e806415bab2a50fc18a98dda"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "4756cff12d9d8a43b114cd056d06ffb2"
server_key_iv: "c2075ed0f36f7be7ad5bd52c0fa581dc"
server_key_version: "encryptionkey@0"
I20260812 11:06:31.705000 30942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "4141b201e806415bab2a50fc18a98dda"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "4756cff12d9d8a43b114cd056d06ffb2"
server_key_iv: "c2075ed0f36f7be7ad5bd52c0fa581dc"
server_key_version: "encryptionkey@0"
I20260812 11:06:31.708837 30942 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:06:31.711352 30961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:31.712734 30942 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:31.712870 30942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "4141b201e806415bab2a50fc18a98dda"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "4756cff12d9d8a43b114cd056d06ffb2"
server_key_iv: "c2075ed0f36f7be7ad5bd52c0fa581dc"
server_key_version: "encryptionkey@0"
I20260812 11:06:31.712980 30942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:31.723826 30942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:31.727102 30942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:31.727288 30942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:31.727926 30942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:31.728838 30942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:31.728886 30942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:31.728942 30942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:31.728968 30942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:31.737700 30942 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:33147
I20260812 11:06:31.737726 31167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:33147 every 8 connection(s)
I20260812 11:06:31.738649 30942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:06:31.741883 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 30942
I20260812 11:06:31.742039 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:06:31.742401 19131 external_mini_cluster.cc:1428] Setting key 6d7ce5db07b7a0699b3ee72f472cd598
Aug 12 11:06:31 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532791, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
I20260812 11:06:31.753212 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:31.740527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:44687 (local address 127.18.174.254:36209)
0812 11:06:31.740662 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:31.740667 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:31.741540 (+ 873us) server_negotiation.cc:407] Connection header received
0812 11:06:31.743194 (+ 1654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:31.743197 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:31.743247 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:31.743325 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:31.744921 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:31.745492 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:31.747017 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:31.747238 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:31.747316 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:31.750221 (+ 2905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:31.750224 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:31.750226 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:31.750251 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:31.751390 (+ 1139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:31.751852 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:31.751854 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:31.751855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:31.751924 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:31.752256 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:31.752259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:31.752260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:31.752440 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:31.752515 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:31.752968 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 11:06:31.753086 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:06:31.754077 31175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:31.740909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.195:44687)
0812 11:06:31.741383 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:31.741428 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:31.742988 (+ 1560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:31.743633 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:31.743641 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:31.744120 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:31.744789 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:31.744806 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:31.745593 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:31.745595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:31.746887 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:31.746898 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:31.747374 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:31.747378 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:31.747570 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:31.748207 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:31.748227 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:31.750052 (+ 1825us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:31.751494 (+ 1442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:31.751499 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:31.751513 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:31.751774 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:31.751993 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:31.751995 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:31.751996 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:31.752176 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:31.752514 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:31.752519 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:31.752770 (+ 251us) client_negotiation.cc:769] Sending connection context
0812 11:06:31.752930 (+ 160us) client_negotiation.cc:240] Negotiation successful
0812 11:06:31.753215 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":116,"threads_started":1}
I20260812 11:06:31.755262 31168 heartbeater.cc:347] Connected to a master server at 127.18.174.254:36209
I20260812 11:06:31.755530 31168 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:31.756155 31168 heartbeater.cc:511] Master 127.18.174.254:36209 requested a full tablet report, sending...
I20260812 11:06:31.757170 30335 ts_manager.cc:194] Registered new tserver with Master: 4141b201e806415bab2a50fc18a98dda (127.18.174.195:33147)
I20260812 11:06:31.757709 30335 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:44687
I20260812 11:06:31.768388 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.18.174.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.174.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.174.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.253.keytab.
Entry for principal oryx/127.18.174.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.253.keytab.
I20260812 11:06:31.797446 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.253:34451
--webserver_interface=127.18.174.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.253.keytab
--principal=oryx/127.18.174.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:42161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:36209,127.18.174.253:34451
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:31.914070 31182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:31.914357 31182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:31.914397 31182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:31.918582 31182 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:31.918658 31182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:31.918675 31182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:31.918691 31182 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:31.918705 31182 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:31.924181 31182 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:42161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:36209,127.18.174.253:34451
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.253.keytab
--principal=oryx/127.18.174.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.253:34451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.174.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
W20260812 11:06:31.924427 31182 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.18.174.254:36209,127.18.174.253:34451'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 11:06:31.925398 31182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:31.926491 31182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:31.935343 31192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:31.935343 31194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:31.935458 31182 server_base.cc:1034] running on GCE node
W20260812 11:06:31.935396 31191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:31.936209 31182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:31.937407 31182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:31.938570 31182 hybrid_clock.cc:648] HybridClock initialized: now 1786532791938544 us; error 46 us; skew 500 ppm
Aug 12 11:06:31 dist-test-slave-lgr5 krb5kdc[30256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532791, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:31.941390 31182 init.cc:377] Logged in from keytab as oryx/127.18.174.253@KRBTEST.COM (short username oryx)
I20260812 11:06:31.942380 31182 webserver.cc:460] Webserver started at http://127.18.174.253:38385/ using document root <none> and password file <none>
I20260812 11:06:31.942970 31182 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:31.943044 31182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:31.943264 31182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:31.945591 31182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/data/instance:
uuid: "f5ac7cfd948b493f88ae0d14539b25e7"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "0141294777433d12dd311fb8d813c38c"
server_key_iv: "11d1423a3e3aaf633ff0d79d47f17638"
server_key_version: "encryptionkey@0"
I20260812 11:06:31.946182 31182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/wal/instance:
uuid: "f5ac7cfd948b493f88ae0d14539b25e7"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "0141294777433d12dd311fb8d813c38c"
server_key_iv: "11d1423a3e3aaf633ff0d79d47f17638"
server_key_version: "encryptionkey@0"
I20260812 11:06:31.950088 31182 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:06:31.952554 31209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:31.953814 31182 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:31.953966 31182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/wal
uuid: "f5ac7cfd948b493f88ae0d14539b25e7"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "0141294777433d12dd311fb8d813c38c"
server_key_iv: "11d1423a3e3aaf633ff0d79d47f17638"
server_key_version: "encryptionkey@0"
I20260812 11:06:31.954069 31182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:31.984571 31182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:31.987561 31182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:31.987732 31182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:31.994954 31182 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.253:34451
I20260812 11:06:31.995244 31307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.253:34451 every 8 connection(s)
I20260812 11:06:31.996075 31182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/data/info.pb
I20260812 11:06:31.999432 31310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:32.003863 31310 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:06:32.004923 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 31182
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532791, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.253@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.174.253@KRBTEST.COM
I20260812 11:06:32.018168 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.005979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42686 (local address 127.18.174.254:36209)
0812 11:06:32.006109 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.006114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.007254 (+ 1140us) server_negotiation.cc:407] Connection header received
0812 11:06:32.008146 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.008149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.008202 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.008272 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.009282 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.009805 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.010893 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.011110 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.011188 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.013962 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.013965 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.013967 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.013997 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.015678 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.016339 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.016342 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.016343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.016435 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.016819 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.016822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.016824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.017154 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.017361 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.017835 (+ 474us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.017995 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:06:32.019134 31320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.006447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.0.0.1:42686)
0812 11:06:32.007090 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.007143 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.007874 (+ 731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.008345 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.008351 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.008826 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.009133 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.009147 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.009933 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.009936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.010759 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.010769 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.011253 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.011258 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.011480 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.012187 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.012209 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.013792 (+ 1583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.015800 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.015808 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.015817 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.016243 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.016529 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.016532 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.016534 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.016721 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.017346 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.017353 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.017572 (+ 219us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.017778 (+ 206us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.018135 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":53,"spinlock_wait_cycles":70144,"thread_start_us":169,"threads_started":1}
I20260812 11:06:32.019140 31318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.006447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47120 (local address 127.18.174.253:34451)
0812 11:06:32.006986 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.007007 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.007053 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:06:32.007869 (+ 816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.007896 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.008180 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.008354 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.009087 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.010064 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.010873 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.011281 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.011468 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.014300 (+ 2832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.014309 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.014324 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.014348 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.016172 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.016654 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.016659 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.016660 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.016755 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.017036 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.017040 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.017041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.017557 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.017782 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.018056 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.018208 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":360,"spinlock_wait_cycles":6400,"thread_start_us":164,"threads_started":1}
I20260812 11:06:32.020627 31310 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532791, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.253@KRBTEST.COM for oryx/127.18.174.253@KRBTEST.COM
I20260812 11:06:32.029438 31320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.021168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:34451 (local address 127.0.0.1:47132)
0812 11:06:32.021364 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.021380 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.021491 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.021713 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.021716 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.021889 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.021983 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.021989 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.023090 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.023094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.023637 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.023647 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.024115 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.024120 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.024212 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.024744 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.024757 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.026140 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.027869 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.027873 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.027875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.028116 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.028401 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.028404 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.028407 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.028491 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.028878 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.028882 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.028974 (+ 92us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.029069 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.029228 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119}
I20260812 11:06:32.029438 31318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.021225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47132 (local address 127.18.174.253:34451)
0812 11:06:32.021490 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.021495 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.021509 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:06:32.021579 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.021582 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.021622 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.021692 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.022094 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.022976 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.023761 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.023987 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.024116 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.026293 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.026296 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.026298 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.026320 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.027733 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.028211 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.028222 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.028224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.028311 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.028576 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.028579 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.028581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.028782 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.028878 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.029127 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.029286 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":202}
I20260812 11:06:32.032994 31310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: Bootstrap starting.
I20260812 11:06:32.035593 31310 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:32.036389 31310 log.cc:824] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:32.038332 31310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: No bootstrap required, opened a new log
I20260812 11:06:32.041389 31310 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } }
I20260812 11:06:32.041603 31310 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:32.041642 31310 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ac7cfd948b493f88ae0d14539b25e7, State: Initialized, Role: FOLLOWER
I20260812 11:06:32.042070 31310 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } }
I20260812 11:06:32.042560 31330 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } } }
I20260812 11:06:32.042685 31330 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:06:32.043295 31310 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 11:06:32.048063 31343 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:06:32.048225 31343 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:06:32.050771 31182 master_runner.cc:428] Detected that this master f5ac7cfd948b493f88ae0d14539b25e7 is joining an existing cluster
I20260812 11:06:32.050838 31182 master_runner.cc:432] Initiating AddMaster RPC to add 127.18.174.253:34451
I20260812 11:06:32.061465 31318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.053295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47138 (local address 127.18.174.253:34451)
0812 11:06:32.053402 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.053407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.053859 (+ 452us) server_negotiation.cc:407] Connection header received
0812 11:06:32.054008 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.054011 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.054050 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.054094 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.054711 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.055422 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.056223 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.056478 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.056585 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.058423 (+ 1838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.058427 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.058430 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.058456 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.059754 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.060332 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.060335 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.060337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.060403 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.060623 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.060626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.060628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.060815 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.060870 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.061154 (+ 284us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.061293 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:06:32.061522 31352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.053237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.0.0.1:42694)
0812 11:06:32.053649 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.053664 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.053773 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.054004 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.054007 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.054227 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.054340 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.054346 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.055355 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.055358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.056296 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.056308 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.056838 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.056842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.056926 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.057525 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.057540 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.057919 (+ 379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.059855 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.059858 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.059860 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.060235 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.060535 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.060538 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.060539 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.060616 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.061013 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.061016 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.061091 (+ 75us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.061181 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.061367 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":59,"spinlock_wait_cycles":9856,"thread_start_us":88,"threads_started":1}
I20260812 11:06:32.061532 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.053313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42694 (local address 127.18.174.254:36209)
0812 11:06:32.053431 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.053435 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.053746 (+ 311us) server_negotiation.cc:407] Connection header received
0812 11:06:32.053862 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.053865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.053910 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.053975 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.054456 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.055237 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.056415 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.056723 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.056817 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.058068 (+ 1251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.058071 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.058073 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.058096 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.059742 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.060327 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.060332 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.060333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.060431 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.060693 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.060696 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.060698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.060912 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.061010 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.061238 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.061363 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:06:32.062345 31357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.053481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:34451 (local address 127.0.0.1:47138)
0812 11:06:32.053772 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.053786 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.053918 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.054214 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.054217 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.054440 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.054593 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.054601 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.055518 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.055521 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.056125 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.056135 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.056728 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.056734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.056838 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.057864 (+ 1026us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.057879 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.058286 (+ 407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.059855 (+ 1569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.059858 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.059860 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.060235 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.060470 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.060472 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.060474 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.060541 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.060910 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.060911 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.060998 (+ 87us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.062108 (+ 1110us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.062219 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"spinlock_wait_cycles":5248,"thread_start_us":106,"threads_started":1}
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532790, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.254@KRBTEST.COM for oryx/127.18.174.253@KRBTEST.COM
I20260812 11:06:32.075685 31359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.066367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:34451 (local address 127.0.0.1:47140)
0812 11:06:32.066735 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.066787 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.066922 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.067215 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.067219 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.067583 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.067694 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.067700 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.068681 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.068684 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.069311 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.069319 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.069932 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.069937 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.070048 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.070527 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.070539 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.072041 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.073927 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.073938 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.073945 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.074247 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.074545 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.074549 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.074551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.074652 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.075050 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.075058 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.075187 (+ 129us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.075317 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.075528 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":94,"threads_started":1}
I20260812 11:06:32.075675 31318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.066407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47140 (local address 127.18.174.253:34451)
0812 11:06:32.066536 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.066540 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.066860 (+ 320us) server_negotiation.cc:407] Connection header received
0812 11:06:32.067048 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.067051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.067106 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.067189 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.067791 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.068587 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.069409 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.069770 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.069864 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.072186 (+ 2322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.072189 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.072192 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.072216 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.073807 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.074352 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.074356 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.074358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.074448 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.074746 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.074751 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.074753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.074933 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.075048 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.075386 (+ 338us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.075504 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:06:32.077476 30335 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.18.174.253:34451: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7"
member_type: NON_VOTER
last_known_addr {
host: "127.18.174.253"
port: 34451
}
attrs {
promote: true
}
}
dest_uuid: "62f6c8a5610b47bb87260c44b13fe041"
cas_config_opid_index: -1
I20260812 11:06:32.078270 30335 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: NON_VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: true } }
I20260812 11:06:32.080327 31363 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER f5ac7cfd948b493f88ae0d14539b25e7 (127.18.174.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: NON_VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: true } } }
I20260812 11:06:32.081117 31259 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:32.082474 31259 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 1 FOLLOWER]: Refusing update from remote peer 62f6c8a5610b47bb87260c44b13fe041: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 11:06:32.082600 31363 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.18.174.253:34451
WARNING: no policy specified for oryx/127.18.174.252@KRBTEST.COM; defaulting to no policy
I20260812 11:06:32.083071 31363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: NON_VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: true } } }
I20260812 11:06:32.083130 31182 master.cc:537] Master@127.18.174.253:34451 shutting down...
I20260812 11:06:32.083268 31363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:32.083240 31365 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: NON_VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:06:32.085304 30315 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260812 11:06:32.086216 30315 consensus_peers.cc:487] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 -> Peer f5ac7cfd948b493f88ae0d14539b25e7 (127.18.174.253:34451): Couldn't send request to peer f5ac7cfd948b493f88ae0d14539b25e7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 11:06:32.087824 31182 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:32.088207 31182 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:32.088330 31182 tablet_replica.cc:330] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.174.252@KRBTEST.COM" created.
I20260812 11:06:32.106261 31182 master.cc:552] Master@127.18.174.253:34451 shutdown complete.
I20260812 11:06:32.106326 31182 master_runner.cc:305] Clearing existing system tablet
I20260812 11:06:32.106575 31182 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:32.106632 31182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:32.107836 31182 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:32.108951 31373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:32.109236 31182 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:32.109359 31182 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:32.109422 31182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/wal
uuid: "f5ac7cfd948b493f88ae0d14539b25e7"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "0141294777433d12dd311fb8d813c38c"
server_key_iv: "11d1423a3e3aaf633ff0d79d47f17638"
server_key_version: "encryptionkey@0"
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.174.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.252.keytab.
Entry for principal oryx/127.18.174.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.252.keytab.
I20260812 11:06:32.111629 31182 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:32.111876 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.252:46007
--webserver_interface=127.18.174.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.252.keytab
--principal=oryx/127.18.174.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:42161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:36209,127.18.174.253:34451,127.18.174.252:46007
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:06:32.114090 31182 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 11:06:32.114187 31182 log.cc:1196] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 11:06:32.114451 31182 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: Deleting consensus metadata
I20260812 11:06:32.114625 31182 master_runner.cc:315] Copying system tablet from 127.18.174.254:36209
I20260812 11:06:32.115906 31182 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: tablet copy: Beginning tablet copy session from remote peer at address 127.18.174.254:36209
I20260812 11:06:32.127009 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.116698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42696 (local address 127.18.174.254:36209)
0812 11:06:32.116835 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.116839 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.120512 (+ 3673us) server_negotiation.cc:407] Connection header received
0812 11:06:32.120673 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.120676 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.120729 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.120801 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.121280 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.121810 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.122618 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.122842 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.122933 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.124039 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.124043 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.124045 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.124073 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.125441 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.125844 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.125848 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.125850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.125931 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.126183 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.126186 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.126188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.126375 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.126466 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.126731 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.126839 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:06:32.127017 31389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.116618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.0.0.1:42696)
0812 11:06:32.120385 (+ 3767us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.120401 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.120562 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.120834 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.120837 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.121039 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.121154 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.121161 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.121922 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.121925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.122499 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.122508 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.122953 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.122957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.123052 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.123545 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.123558 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.123885 (+ 327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.125550 (+ 1665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.125553 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.125556 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.125754 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.126015 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.126019 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.126021 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.126102 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.126467 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.126470 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.126575 (+ 105us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.126662 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.126814 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3681,"thread_start_us":109,"threads_started":1}
I20260812 11:06:32.128170 30372 tablet_copy_service.cc:140] P 62f6c8a5610b47bb87260c44b13fe041: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer f5ac7cfd948b493f88ae0d14539b25e7 ({username='oryx', principal='oryx/127.18.174.253@KRBTEST.COM'} at 127.0.0.1:42696)
I20260812 11:06:32.128363 30372 tablet_copy_service.cc:161] P 62f6c8a5610b47bb87260c44b13fe041: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer f5ac7cfd948b493f88ae0d14539b25e7 at {username='oryx', principal='oryx/127.18.174.253@KRBTEST.COM'} at 127.0.0.1:42696: session id = f5ac7cfd948b493f88ae0d14539b25e7-00000000000000000000000000000000
I20260812 11:06:32.129968 30372 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 11:06:32.131830 31182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 11:06:32.133901 31182 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: tablet copy: Starting download of 0 data blocks...
I20260812 11:06:32.134100 31182 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: tablet copy: Starting download of 1 WAL segments...
I20260812 11:06:32.135897 31182 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 11:06:32.137691 30372 tablet_copy_service.cc:342] P 62f6c8a5610b47bb87260c44b13fe041: Request end of tablet copy session f5ac7cfd948b493f88ae0d14539b25e7-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.18.174.253@KRBTEST.COM'} at 127.0.0.1:42696
I20260812 11:06:32.137892 30372 tablet_copy_service.cc:433] P 62f6c8a5610b47bb87260c44b13fe041: ending tablet copy session f5ac7cfd948b493f88ae0d14539b25e7-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer f5ac7cfd948b493f88ae0d14539b25e7
I20260812 11:06:32.145157 31182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:32.146929 31390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:32.147149 31392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:32.147233 31398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:32.147423 31182 server_base.cc:1034] running on GCE node
I20260812 11:06:32.147619 31182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:32.147919 31182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:32.149052 31182 hybrid_clock.cc:648] HybridClock initialized: now 1786532792149039 us; error 44 us; skew 500 ppm
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532792, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:32.150444 31182 init.cc:377] Logged in from keytab as oryx/127.18.174.253@KRBTEST.COM (short username oryx)
I20260812 11:06:32.150938 31182 webserver.cc:460] Webserver started at http://127.18.174.253:42493/ using document root <none> and password file <none>
I20260812 11:06:32.151130 31182 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:32.151167 31182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:32.152364 31182 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:32.153244 31413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:32.153460 31182 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 11:06:32.153530 31182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/wal
uuid: "f5ac7cfd948b493f88ae0d14539b25e7"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "0141294777433d12dd311fb8d813c38c"
server_key_iv: "11d1423a3e3aaf633ff0d79d47f17638"
server_key_version: "encryptionkey@0"
I20260812 11:06:32.153614 31182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:32.174464 31182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:32.176365 31182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:32.181182 31182 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.253:34451
I20260812 11:06:32.181195 31513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.253:34451 every 8 connection(s)
I20260812 11:06:32.181798 31182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-1/data/info.pb
I20260812 11:06:32.183523 31514 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:06:32.184432 31514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: Bootstrap starting.
I20260812 11:06:32.193142 31514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:06:32.193456 31514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: Bootstrap complete.
I20260812 11:06:32.193991 31514 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: NON_VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: true } }
I20260812 11:06:32.194108 31514 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5ac7cfd948b493f88ae0d14539b25e7, State: Initialized, Role: LEARNER
I20260812 11:06:32.194214 31514 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: NON_VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: true } }
I20260812 11:06:32.194542 31518 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: NON_VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: true } } }
I20260812 11:06:32.194695 31514 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:32.194721 31518 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:06:32.198160 31544 catalog_manager.cc:1259] Loaded cluster ID: 50ee3a6bda774d0fad714ef7f751cf36
I20260812 11:06:32.198211 31544 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: loading cluster ID for follower catalog manager: success
I20260812 11:06:32.199828 31544 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: acquiring CA information for follower catalog manager: success
I20260812 11:06:32.201005 31544 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 11:06:32.266424 31374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:32.266728 31374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:32.266769 31374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:32.271314 31374 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:32.271389 31374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:32.271407 31374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:32.271422 31374 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:32.271437 31374 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:32.277158 31374 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:42161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:36209,127.18.174.253:34451,127.18.174.252:46007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.252.keytab
--principal=oryx/127.18.174.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.252:46007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.174.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:32.278311 31374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:32.279381 31374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:32.288527 31553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:32.288555 31557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:32.288671 31374 server_base.cc:1034] running on GCE node
W20260812 11:06:32.288558 31555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:32.289448 31374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:32.290649 31374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:32.291818 31374 hybrid_clock.cc:648] HybridClock initialized: now 1786532792291791 us; error 40 us; skew 500 ppm
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532792, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:32.294739 31374 init.cc:377] Logged in from keytab as oryx/127.18.174.252@KRBTEST.COM (short username oryx)
I20260812 11:06:32.295737 31374 webserver.cc:460] Webserver started at http://127.18.174.252:35987/ using document root <none> and password file <none>
I20260812 11:06:32.296397 31374 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:32.296475 31374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:32.296705 31374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:32.298870 31374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/data/instance:
uuid: "bcae5fbb46344be18522cd8f928c4d8d"
format_stamp: "Formatted at 2026-08-12 11:06:32 on dist-test-slave-lgr5"
server_key: "b8c84043c9a9038690c60dfc451fbeab"
server_key_iv: "4a3f0df9e3a31677a1dbb2b045f2cf1a"
server_key_version: "encryptionkey@0"
I20260812 11:06:32.299460 31374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/wal/instance:
uuid: "bcae5fbb46344be18522cd8f928c4d8d"
format_stamp: "Formatted at 2026-08-12 11:06:32 on dist-test-slave-lgr5"
server_key: "b8c84043c9a9038690c60dfc451fbeab"
server_key_iv: "4a3f0df9e3a31677a1dbb2b045f2cf1a"
server_key_version: "encryptionkey@0"
I20260812 11:06:32.303892 31374 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260812 11:06:32.306978 31572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:32.308597 31374 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:32.308720 31374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/wal
uuid: "bcae5fbb46344be18522cd8f928c4d8d"
format_stamp: "Formatted at 2026-08-12 11:06:32 on dist-test-slave-lgr5"
server_key: "b8c84043c9a9038690c60dfc451fbeab"
server_key_iv: "4a3f0df9e3a31677a1dbb2b045f2cf1a"
server_key_version: "encryptionkey@0"
I20260812 11:06:32.308833 31374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:32.327957 30680 heartbeater.cc:503] Master 127.18.174.254:36209 was elected leader, sending a full tablet report...
I20260812 11:06:32.335788 31374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:32.338747 31374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:32.338939 31374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:32.346387 31374 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.252:46007
I20260812 11:06:32.346747 31666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.252:46007 every 8 connection(s)
I20260812 11:06:32.347558 31374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/data/info.pb
I20260812 11:06:32.350518 31669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:32.350783 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 31374
I20260812 11:06:32.356369 31669 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.174.252@KRBTEST.COM
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532792, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.252@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
I20260812 11:06:32.366101 31671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.352431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57818 (local address 127.18.174.252:46007)
0812 11:06:32.352865 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.352881 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.352919 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:06:32.353620 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.353638 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.353999 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.354288 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.355333 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.356406 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.357516 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.358073 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.358236 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.360926 (+ 2690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.360932 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.360942 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.360970 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.362653 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.363112 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.363116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.363121 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.363230 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.363490 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.363494 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.363495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.364052 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.364257 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.364558 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.364860 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"spinlock_wait_cycles":9088,"thread_start_us":128,"threads_started":1}
I20260812 11:06:32.367699 31672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.358372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.0.0.1:42700)
0812 11:06:32.358862 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.358913 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.359034 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.359306 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.359312 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.359661 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.359794 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.359802 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.360717 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.360721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.361552 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.361563 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.362113 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.362116 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.362201 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.362642 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.362654 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.364327 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.366149 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.366158 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.366163 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.366470 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.366744 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.366747 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.366749 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.366841 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.367173 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.367179 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.367291 (+ 112us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.367410 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.367559 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"spinlock_wait_cycles":7552,"thread_start_us":156,"threads_started":1}
I20260812 11:06:32.367756 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.358582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42700 (local address 127.18.174.254:36209)
0812 11:06:32.358715 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.358720 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.358992 (+ 272us) server_negotiation.cc:407] Connection header received
0812 11:06:32.359124 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.359127 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.359176 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.359243 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.359937 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.360563 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.361677 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.362000 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.362114 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.364496 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.364501 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.364503 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.364531 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.365982 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.366568 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.366571 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.366573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.366659 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.366921 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.366923 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.366924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.367086 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.367155 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.367488 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.367614 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 11:06:32.368912 31669 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532792, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.252@KRBTEST.COM for oryx/127.18.174.253@KRBTEST.COM
I20260812 11:06:32.378862 31672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.369399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:34451 (local address 127.0.0.1:47146)
0812 11:06:32.369525 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.369537 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.369603 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.370019 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.370022 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.370184 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.370297 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.370305 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.371637 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.371641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.372250 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.372260 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.372706 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.372710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.372806 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.373236 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.373248 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.374686 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.376848 (+ 2162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.376852 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.376855 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.377150 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.377546 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.377550 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.377553 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.377662 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.378225 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.378229 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.378349 (+ 120us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.378483 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.378654 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 11:06:32.379500 31678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.369547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47146 (local address 127.18.174.253:34451)
0812 11:06:32.369817 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.369820 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.369832 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:06:32.369868 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.369870 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.369910 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.369990 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.370439 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.371532 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.372370 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.372607 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.372697 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.374838 (+ 2141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.374841 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.374843 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.374873 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.376689 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.377283 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.377288 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.377291 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.377419 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.377780 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.377784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.377786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.378059 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.378170 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.379140 (+ 970us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.379300 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":110,"threads_started":1}
I20260812 11:06:32.380332 31669 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532792, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.252@KRBTEST.COM for oryx/127.18.174.252@KRBTEST.COM
I20260812 11:06:32.387975 31672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.380854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:46007 (local address 127.0.0.1:57830)
0812 11:06:32.380979 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.380994 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.381085 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.381314 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.381317 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.381497 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.381603 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.381610 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.382888 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.382891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.383392 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.383400 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.383848 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.383850 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.383907 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.384325 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.384336 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.385505 (+ 1169us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.386831 (+ 1326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.386834 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.386836 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.387026 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.387218 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.387220 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.387222 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.387283 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.387563 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.387565 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.387643 (+ 78us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.387719 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.387825 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 11:06:32.388003 31671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.380885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57830 (local address 127.18.174.252:46007)
0812 11:06:32.381002 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.381006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.381038 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:06:32.381175 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.381178 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.381219 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.381279 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.381719 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.382419 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.383515 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.383760 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.383844 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.385629 (+ 1785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.385631 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.385633 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.385655 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.386742 (+ 1087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.387096 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.387098 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.387099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.387161 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.387341 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.387342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.387344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.387495 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.387565 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.387761 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.387876 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":39}
I20260812 11:06:32.390956 31669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: Bootstrap starting.
I20260812 11:06:32.393335 31669 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:32.394035 31669 log.cc:824] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:32.395987 31669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: No bootstrap required, opened a new log
I20260812 11:06:32.398950 31669 raft_consensus.cc:348] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } }
I20260812 11:06:32.399152 31669 raft_consensus.cc:374] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:32.399194 31669 raft_consensus.cc:729] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcae5fbb46344be18522cd8f928c4d8d, State: Initialized, Role: FOLLOWER
I20260812 11:06:32.399595 31669 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } }
I20260812 11:06:32.400049 31685 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } } }
I20260812 11:06:32.400270 31685 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:06:32.400890 31669 sys_catalog.cc:564] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [sys.catalog]: configured and running, proceeding with master startup.
W20260812 11:06:32.405601 31709 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:06:32.405680 31709 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:06:32.408929 31374 master_runner.cc:428] Detected that this master bcae5fbb46344be18522cd8f928c4d8d is joining an existing cluster
I20260812 11:06:32.409001 31374 master_runner.cc:432] Initiating AddMaster RPC to add 127.18.174.252:46007
I20260812 11:06:32.420501 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 30443
I20260812 11:06:32.440400 31671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.412035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57840 (local address 127.18.174.252:46007)
0812 11:06:32.412157 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.412161 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.412496 (+ 335us) server_negotiation.cc:407] Connection header received
0812 11:06:32.412624 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.412627 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.412665 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.412711 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.413627 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.414417 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.415861 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.416279 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.416398 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.417636 (+ 1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.417640 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.417643 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.417668 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.437890 (+ 20222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.439025 (+ 1135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.439029 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.439030 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.439115 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.439378 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.439381 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.439383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.439640 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.439713 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.440051 (+ 338us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.440216 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":29}
I20260812 11:06:32.440974 31719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.412013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:46007 (local address 127.0.0.1:57840)
0812 11:06:32.412429 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.412440 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.412544 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.412850 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.412853 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.413271 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.413526 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.413532 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.414568 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.414571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.415739 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.415747 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.416415 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.416419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.416526 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.417075 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.417088 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.417483 (+ 395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.438092 (+ 20609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.438095 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.438098 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.438909 (+ 811us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.439216 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.439219 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.439221 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.439300 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.439774 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.439777 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.439867 (+ 90us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.440657 (+ 790us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.440797 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":218,"thread_start_us":114,"threads_started":1}
I20260812 11:06:32.441232 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.412411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42714 (local address 127.18.174.254:36209)
0812 11:06:32.412542 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.412546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.412562 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:06:32.412607 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.412610 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.412659 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.412738 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.413614 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.414444 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.416667 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.416988 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.417072 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.437756 (+ 20684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.437762 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.437765 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.437805 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.439383 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.439825 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.439829 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.439831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.439918 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.440257 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.440260 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.440262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.440482 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.440555 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.440942 (+ 387us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.441086 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:06:32.441748 31716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.411523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.0.0.1:42714)
0812 11:06:32.411839 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.411854 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.411976 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.412872 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.412875 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.413206 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.413460 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.413471 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.414601 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.414605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.416538 (+ 1933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.416545 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.417229 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.417233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.417325 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.417843 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.417857 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.437446 (+ 19589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.439501 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.439504 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.439506 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.439715 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.440037 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.440040 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.440042 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.440150 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.440629 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.440632 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.440737 (+ 105us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.441389 (+ 652us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.441578 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":94,"thread_start_us":115,"threads_started":1}
I20260812 11:06:32.444656 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:34803
--local_ip_for_outbound_sockets=127.18.174.193
--tserver_master_addrs=127.18.174.254:36209
--webserver_port=41803
--webserver_interface=127.18.174.193
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.193.keytab
--principal=oryx/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:42161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.18.174.254:36209,127.18.174.253:34451
--tserver_master_addrs=127.18.174.254:36209,127.18.174.253:34451,127.18.174.252:46007 with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:06:32.446990 31678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.411678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47160 (local address 127.18.174.253:34451)
0812 11:06:32.411822 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.411827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.412384 (+ 557us) server_negotiation.cc:407] Connection header received
0812 11:06:32.412725 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.412728 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.412780 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.412839 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.413655 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.414422 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.415863 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.416276 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.416350 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.441847 (+ 25497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.441852 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.441855 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.441890 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.443658 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.445416 (+ 1758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.445420 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.445422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.445525 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.445910 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.445914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.445915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.446163 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.446247 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.446631 (+ 384us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.446809 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:06:32.447551 31720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.411567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:34451 (local address 127.0.0.1:47160)
0812 11:06:32.412288 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.412302 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.412454 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.412975 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.412978 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.413277 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.413512 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.413521 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.414568 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.414571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.415713 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.415727 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.416579 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.416582 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.416662 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.436993 (+ 20331us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.437018 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.441648 (+ 4630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.443795 (+ 2147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.443798 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.443801 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.444747 (+ 946us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.445645 (+ 898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.445648 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.445650 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.445740 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.446306 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.446308 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.446449 (+ 141us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.447209 (+ 760us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.447371 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"mutex_wait_us":131,"thread_start_us":70,"threads_started":1}
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532790, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.254@KRBTEST.COM for oryx/127.18.174.252@KRBTEST.COM
I20260812 11:06:32.456414 31359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.446098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:46007 (local address 127.0.0.1:57850)
0812 11:06:32.446321 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.446336 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.446421 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.446906 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.446908 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.447109 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.447216 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.447222 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.448512 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.448515 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.449288 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.449301 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.450005 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.450009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.450115 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.450632 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.450646 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.452294 (+ 1648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.454390 (+ 2096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.454394 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.454396 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.454794 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.455218 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.455222 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.455224 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.455339 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.455805 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.455809 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.455925 (+ 116us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.456032 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.456231 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116}
I20260812 11:06:32.456439 31671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.446162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57850 (local address 127.18.174.252:46007)
0812 11:06:32.446581 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.446585 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.446597 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:06:32.446669 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.446672 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.446721 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.446785 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.447604 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.448383 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.449419 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.449763 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.449874 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.452452 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.452456 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.452460 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.452489 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.454244 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.454977 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.454981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.454983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.455097 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.455438 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.455441 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.455443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.455699 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.455807 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.456133 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.456274 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343}
I20260812 11:06:32.457934 30335 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.18.174.252:46007: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d"
member_type: NON_VOTER
last_known_addr {
host: "127.18.174.252"
port: 46007
}
attrs {
promote: true
}
}
dest_uuid: "62f6c8a5610b47bb87260c44b13fe041"
cas_config_opid_index: 5
I20260812 11:06:32.458622 30335 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: NON_VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: true } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } }
I20260812 11:06:32.459774 31363 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER bcae5fbb46344be18522cd8f928c4d8d (127.18.174.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: NON_VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: true } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } } }
I20260812 11:06:32.461325 31363 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.18.174.252:46007
I20260812 11:06:32.461527 31363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: NON_VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: true } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } } }
I20260812 11:06:32.461627 31363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:32.462862 31622 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:32.464510 31374 master.cc:537] Master@127.18.174.252:46007 shutting down...
I20260812 11:06:32.466547 31359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.459975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:34451 (local address 127.0.0.1:47172)
0812 11:06:32.460691 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.460705 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.460803 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.461230 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.461233 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.461250 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:32.461342 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.461348 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.462591 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.462594 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.464171 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.464186 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.466005 (+ 1819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.466010 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.466120 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.466182 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.466274 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.466368 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642}
I20260812 11:06:32.467414 31678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.460261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47172 (local address 127.18.174.253:34451)
0812 11:06:32.460594 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.460599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.460881 (+ 282us) server_negotiation.cc:407] Connection header received
0812 11:06:32.460938 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.460941 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.461006 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.461097 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:32.461542 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.462353 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.464392 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.465570 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.465698 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.465879 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.467073 (+ 1194us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.467276 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247}
I20260812 11:06:32.468612 31464 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 1 LEARNER]: Refusing update from remote peer 62f6c8a5610b47bb87260c44b13fe041: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 11:06:32.468628 31622 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 1 FOLLOWER]: Refusing update from remote peer 62f6c8a5610b47bb87260c44b13fe041: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 11:06:32.469173 31365 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: NON_VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 11:06:32.469353 31363 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:06:32.471350 30314 consensus_peers.cc:487] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 -> Peer bcae5fbb46344be18522cd8f928c4d8d (127.18.174.252:46007): Couldn't send request to peer bcae5fbb46344be18522cd8f928c4d8d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 11:06:32.471805 31464 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER bcae5fbb46344be18522cd8f928c4d8d (127.18.174.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: NON_VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: true } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } } }
I20260812 11:06:32.473150 31374 raft_consensus.cc:2229] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:32.473433 31374 raft_consensus.cc:2258] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:32.473528 31374 tablet_replica.cc:330] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: stopping tablet replica
I20260812 11:06:32.474460 31518 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62f6c8a5610b47bb87260c44b13fe041. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: NON_VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: true } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } } }
I20260812 11:06:32.474591 31518 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:06:32.474687 31518 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: NON_VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: true } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } } }
I20260812 11:06:32.474757 31518 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:06:32.476786 31365 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041: attempting to promote NON_VOTER f5ac7cfd948b493f88ae0d14539b25e7 to VOTER
I20260812 11:06:32.477341 31365 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } }
I20260812 11:06:32.478592 31464 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 1 LEARNER]: Refusing update from remote peer 62f6c8a5610b47bb87260c44b13fe041: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 11:06:32.479123 31366 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 11:06:32.479653 31359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.478989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:46007 (local address 127.0.0.1:57856)
0812 11:06:32.479484 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.479565 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:46007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416}
I20260812 11:06:32.480439 31359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.480185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:46007 (local address 127.0.0.1:57858)
0812 11:06:32.480328 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.480373 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:46007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260812 11:06:32.480571 30314 consensus_peers.cc:487] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 -> Peer bcae5fbb46344be18522cd8f928c4d8d (127.18.174.252:46007): Couldn't send request to peer bcae5fbb46344be18522cd8f928c4d8d. Status: Network error: Client connection negotiation failed: client connection to 127.18.174.252:46007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 11:06:32.481541 31366 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, f5ac7cfd948b493f88ae0d14539b25e7 (127.18.174.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } } }
I20260812 11:06:32.482108 31374 master.cc:552] Master@127.18.174.252:46007 shutdown complete.
I20260812 11:06:32.482149 31374 master_runner.cc:305] Clearing existing system tablet
I20260812 11:06:32.482546 31374 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:32.482599 31374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:32.483156 31366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } } }
I20260812 11:06:32.483289 31366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:32.483434 31366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } } }
I20260812 11:06:32.483510 31366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:32.483999 31374 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:32.484561 31464 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, f5ac7cfd948b493f88ae0d14539b25e7 (127.18.174.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } } }
I20260812 11:06:32.486653 31724 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } } }
I20260812 11:06:32.486835 31724 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:06:32.488306 31729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:32.488544 31374 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:32.488698 31374 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.001s
I20260812 11:06:32.488739 31374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/wal
uuid: "bcae5fbb46344be18522cd8f928c4d8d"
format_stamp: "Formatted at 2026-08-12 11:06:32 on dist-test-slave-lgr5"
server_key: "b8c84043c9a9038690c60dfc451fbeab"
server_key_iv: "4a3f0df9e3a31677a1dbb2b045f2cf1a"
server_key_version: "encryptionkey@0"
I20260812 11:06:32.490994 31374 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:32.493911 31374 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 11:06:32.494020 31374 log.cc:1196] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 11:06:32.494302 31374 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: Deleting consensus metadata
I20260812 11:06:32.494480 31374 master_runner.cc:315] Copying system tablet from 127.18.174.254:36209
I20260812 11:06:32.495790 31374 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: tablet copy: Beginning tablet copy session from remote peer at address 127.18.174.254:36209
I20260812 11:06:32.507054 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.496608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42724 (local address 127.18.174.254:36209)
0812 11:06:32.496747 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.496752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.497058 (+ 306us) server_negotiation.cc:407] Connection header received
0812 11:06:32.497282 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.497286 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.497345 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.497450 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.498192 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.499011 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.500295 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.500644 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.500727 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.503144 (+ 2417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.503149 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.503152 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.503184 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.504942 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.505518 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.505522 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.505524 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.505620 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.505964 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.505968 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.505969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.506223 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.506317 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.506715 (+ 398us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.506860 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:06:32.507701 31736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.496505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.0.0.1:42724)
0812 11:06:32.496927 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.496944 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.497153 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.497599 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.497603 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.497846 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.498012 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.498021 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.499178 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.499181 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.500125 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.500139 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.500923 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.500928 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.501039 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.502176 (+ 1137us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.502195 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.502959 (+ 764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.505093 (+ 2134us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.505097 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.505099 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.505388 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.505753 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.505757 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.505759 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.505852 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.506401 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.506404 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.506518 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.507310 (+ 792us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.507488 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":109,"threads_started":1}
I20260812 11:06:32.508316 30372 tablet_copy_service.cc:140] P 62f6c8a5610b47bb87260c44b13fe041: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer bcae5fbb46344be18522cd8f928c4d8d ({username='oryx', principal='oryx/127.18.174.252@KRBTEST.COM'} at 127.0.0.1:42724)
I20260812 11:06:32.508432 30372 tablet_copy_service.cc:161] P 62f6c8a5610b47bb87260c44b13fe041: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer bcae5fbb46344be18522cd8f928c4d8d at {username='oryx', principal='oryx/127.18.174.252@KRBTEST.COM'} at 127.0.0.1:42724: session id = bcae5fbb46344be18522cd8f928c4d8d-00000000000000000000000000000000
I20260812 11:06:32.509578 30372 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 11:06:32.511009 31374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 11:06:32.513623 31374 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: tablet copy: Starting download of 0 data blocks...
I20260812 11:06:32.513859 31374 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: tablet copy: Starting download of 1 WAL segments...
I20260812 11:06:32.515686 31374 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 11:06:32.518029 30372 tablet_copy_service.cc:342] P 62f6c8a5610b47bb87260c44b13fe041: Request end of tablet copy session bcae5fbb46344be18522cd8f928c4d8d-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.18.174.252@KRBTEST.COM'} at 127.0.0.1:42724
I20260812 11:06:32.518129 30372 tablet_copy_service.cc:433] P 62f6c8a5610b47bb87260c44b13fe041: ending tablet copy session bcae5fbb46344be18522cd8f928c4d8d-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer bcae5fbb46344be18522cd8f928c4d8d
I20260812 11:06:32.526559 31374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:32.528582 31737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:32.528687 31738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:32.529031 31740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:32.529265 31374 server_base.cc:1034] running on GCE node
I20260812 11:06:32.529467 31374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:32.529860 31374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:32.531085 31374 hybrid_clock.cc:648] HybridClock initialized: now 1786532792531069 us; error 32 us; skew 500 ppm
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532792, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:32.532946 31374 init.cc:377] Logged in from keytab as oryx/127.18.174.252@KRBTEST.COM (short username oryx)
I20260812 11:06:32.533551 31374 webserver.cc:460] Webserver started at http://127.18.174.252:44857/ using document root <none> and password file <none>
I20260812 11:06:32.533819 31374 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:32.533916 31374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:32.535494 31374 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 11:06:32.536732 31751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:32.536989 31374 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 11:06:32.537113 31374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/wal
uuid: "bcae5fbb46344be18522cd8f928c4d8d"
format_stamp: "Formatted at 2026-08-12 11:06:32 on dist-test-slave-lgr5"
server_key: "b8c84043c9a9038690c60dfc451fbeab"
server_key_iv: "4a3f0df9e3a31677a1dbb2b045f2cf1a"
server_key_version: "encryptionkey@0"
I20260812 11:06:32.537287 31374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:32.545352 30934 heartbeater.cc:503] Master 127.18.174.254:36209 was elected leader, sending a full tablet report...
I20260812 11:06:32.551419 31374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:32.553759 31374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:32.558889 31374 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.252:46007
I20260812 11:06:32.558929 31845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.252:46007 every 8 connection(s)
I20260812 11:06:32.559499 31374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/master-2/data/info.pb
I20260812 11:06:32.561565 31847 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:06:32.562879 31847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: Bootstrap starting.
I20260812 11:06:32.575613 31847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:06:32.576154 31847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: Bootstrap complete.
I20260812 11:06:32.576915 31847 raft_consensus.cc:348] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } }
I20260812 11:06:32.577185 31847 raft_consensus.cc:729] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcae5fbb46344be18522cd8f928c4d8d, State: Initialized, Role: LEARNER
I20260812 11:06:32.577365 31847 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } }
I20260812 11:06:32.578009 31847 sys_catalog.cc:564] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:32.578121 31852 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } } }
I20260812 11:06:32.578277 31852 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [sys.catalog]: This master's current role is: LEARNER
I20260812 11:06:32.582479 31877 catalog_manager.cc:1259] Loaded cluster ID: 50ee3a6bda774d0fad714ef7f751cf36
I20260812 11:06:32.582549 31877 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: loading cluster ID for follower catalog manager: success
I20260812 11:06:32.584790 31877 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: acquiring CA information for follower catalog manager: success
I20260812 11:06:32.586289 31877 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 11:06:32.587868 31722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:32.588238 31722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:32.588310 31722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:32.592415 31722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:32.592491 31722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:32.592566 31722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:32.598223 31722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:42161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.193.keytab
--principal=oryx/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:34803
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=41803
--tserver_master_addrs=127.18.174.254:36209,127.18.174.253:34451,127.18.174.252:46007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:32.599270 31722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:32.600351 31722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:32.610098 31888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:32.610098 31887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:32.610093 31892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:32.610495 31722 server_base.cc:1034] running on GCE node
I20260812 11:06:32.610906 31722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:32.611536 31722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:32.612689 31722 hybrid_clock.cc:648] HybridClock initialized: now 1786532792612661 us; error 40 us; skew 500 ppm
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532792, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:32.615625 31722 init.cc:377] Logged in from keytab as oryx/127.18.174.193@KRBTEST.COM (short username oryx)
I20260812 11:06:32.616714 31722 webserver.cc:460] Webserver started at http://127.18.174.193:41803/ using document root <none> and password file <none>
I20260812 11:06:32.617401 31722 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:32.617494 31722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:32.621810 31722 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:06:32.624187 31905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:32.625658 31722 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:32.625802 31722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "4721022f36a84a28b9502b8310486068"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "68a6b5cc84aebc93dc595ab578c60596"
server_key_iv: "b91badc066b1459328b15f9f7ce95225"
server_key_version: "encryptionkey@0"
I20260812 11:06:32.626441 31722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:32.646991 31722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:32.650084 31722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:32.650281 31722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:32.650931 31722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:32.651925 31722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:32.651978 31722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:32.652034 31722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:32.652064 31722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:32.661612 31722 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:34803
I20260812 11:06:32.661638 32091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:34803 every 8 connection(s)
I20260812 11:06:32.662704 31722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:06:32.668332 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 31722
I20260812 11:06:32.668545 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 30690
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532792, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532792, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.253@KRBTEST.COM
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532792, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.252@KRBTEST.COM
I20260812 11:06:32.687377 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.664703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:35233 (local address 127.18.174.254:36209)
0812 11:06:32.664847 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.664852 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.666086 (+ 1234us) server_negotiation.cc:407] Connection header received
0812 11:06:32.667300 (+ 1214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.667304 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.667362 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.667415 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.674273 (+ 6858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.675128 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.677367 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.677725 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.677807 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.682254 (+ 4447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.682259 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.682262 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.682297 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.684384 (+ 2087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.685275 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.685278 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.685280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.685393 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.685873 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.685876 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.685878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.686127 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.686213 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.687069 (+ 856us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.687206 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:06:32.687422 31678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.664771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:46019 (local address 127.18.174.253:34451)
0812 11:06:32.664882 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.664887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.666086 (+ 1199us) server_negotiation.cc:407] Connection header received
0812 11:06:32.667300 (+ 1214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.667304 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.667364 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.667415 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.674273 (+ 6858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.675128 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.677367 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.677725 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.677807 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.682258 (+ 4451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.682263 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.682266 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.682307 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.684352 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.685394 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.685399 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.685401 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.685527 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.685894 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.685898 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.685900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.686170 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.686266 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.687086 (+ 820us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.687244 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:06:32.688052 32108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.666626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:56965 (local address 127.18.174.252:46007)
0812 11:06:32.666895 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.666899 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.666911 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:06:32.667255 (+ 344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.667258 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.667317 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.667399 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.674291 (+ 6892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.675737 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.677375 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.677852 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.677968 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.682254 (+ 4286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.682259 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.682262 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.682297 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.684384 (+ 2087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.685274 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.685278 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.685280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.685392 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.685873 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.685876 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.685878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.686127 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.686214 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.687746 (+ 1532us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.687890 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":93,"threads_started":1}
I20260812 11:06:32.689299 32106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.665285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.193:35233)
0812 11:06:32.665896 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.665961 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.667049 (+ 1088us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.667604 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.667612 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.668053 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.674010 (+ 5957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.674046 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.675355 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.675358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.677208 (+ 1850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.677221 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.678050 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.678054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.678388 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.679409 (+ 1021us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.679421 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.682044 (+ 2623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.684544 (+ 2500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.684552 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.684576 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.685140 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.685506 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.685509 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.685511 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.685759 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.686273 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.686281 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.686741 (+ 460us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.688058 (+ 1317us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.688409 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"mutex_wait_us":473,"spinlock_wait_cycles":167296,"thread_start_us":161,"threads_started":1}
I20260812 11:06:32.689584 32107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.666467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:46007 (local address 127.18.174.193:56965)
0812 11:06:32.666706 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.666718 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.667050 (+ 332us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.667602 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.667609 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.668047 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.674014 (+ 5967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.674049 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.675899 (+ 1850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.675903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.677191 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.677208 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.678137 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.678141 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.678385 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.679300 (+ 915us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.679316 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.682044 (+ 2728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.684544 (+ 2500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.684552 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.684576 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.685153 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.685506 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.685509 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.685511 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.685757 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.686273 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.686281 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.686742 (+ 461us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.686971 (+ 229us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.687340 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":141,"spinlock_wait_cycles":146816,"thread_start_us":76,"threads_started":1}
I20260812 11:06:32.690316 32105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.665285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:34451 (local address 127.18.174.193:46019)
0812 11:06:32.665896 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.665961 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.667050 (+ 1089us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.667604 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.667612 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.668104 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.674011 (+ 5907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.674046 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.675355 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.675358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.677209 (+ 1851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.677221 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.678050 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.678054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.678384 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.679260 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.679286 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.681959 (+ 2673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.684545 (+ 2586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.684553 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.684577 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.685244 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.685660 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.685664 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.685666 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.685771 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.686332 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.686334 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.686750 (+ 416us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.687603 (+ 853us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.690113 (+ 2510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"mutex_wait_us":464,"spinlock_wait_cycles":120320,"thread_start_us":171,"threads_started":1}
I20260812 11:06:32.691463 32098 heartbeater.cc:347] Connected to a master server at 127.18.174.254:36209
I20260812 11:06:32.691510 32100 heartbeater.cc:347] Connected to a master server at 127.18.174.253:34451
I20260812 11:06:32.691538 32092 heartbeater.cc:347] Connected to a master server at 127.18.174.252:46007
I20260812 11:06:32.691740 32098 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:32.691795 32092 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:32.692402 32092 heartbeater.cc:511] Master 127.18.174.252:46007 requested a full tablet report, sending...
I20260812 11:06:32.692400 32098 heartbeater.cc:511] Master 127.18.174.254:36209 requested a full tablet report, sending...
I20260812 11:06:32.691744 32100 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:32.693259 32100 heartbeater.cc:511] Master 127.18.174.253:34451 requested a full tablet report, sending...
I20260812 11:06:32.693869 30335 ts_manager.cc:194] Re-registered known tserver with Master: 4721022f36a84a28b9502b8310486068 (127.18.174.193:34803)
I20260812 11:06:32.694455 30335 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:35233
I20260812 11:06:32.694602 31442 ts_manager.cc:194] Registered new tserver with Master: 4721022f36a84a28b9502b8310486068 (127.18.174.193:34803)
I20260812 11:06:32.695451 31785 ts_manager.cc:194] Registered new tserver with Master: 4721022f36a84a28b9502b8310486068 (127.18.174.193:34803)
I20260812 11:06:32.710407 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:44457
--local_ip_for_outbound_sockets=127.18.174.194
--tserver_master_addrs=127.18.174.254:36209
--webserver_port=39095
--webserver_interface=127.18.174.194
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.194.keytab
--principal=oryx/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:42161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.18.174.254:36209,127.18.174.253:34451
--tserver_master_addrs=127.18.174.254:36209,127.18.174.253:34451,127.18.174.252:46007 with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:06:32.759769 31168 heartbeater.cc:503] Master 127.18.174.254:36209 was elected leader, sending a full tablet report...
W20260812 11:06:32.829072 32109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:32.829352 32109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:32.829396 32109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:32.833539 32109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:32.833619 32109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:32.833681 32109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:06:32.839314 32109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:42161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.194.keytab
--principal=oryx/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:44457
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=39095
--tserver_master_addrs=127.18.174.254:36209,127.18.174.253:34451,127.18.174.252:46007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:32.840483 32109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:32.841528 32109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:32.851931 32119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:32.851990 32109 server_base.cc:1034] running on GCE node
W20260812 11:06:32.851927 32120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:32.852296 32122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:32.852783 32109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:32.853503 32109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:32.854674 32109 hybrid_clock.cc:648] HybridClock initialized: now 1786532792854648 us; error 38 us; skew 500 ppm
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532792, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:32.857556 32109 init.cc:377] Logged in from keytab as oryx/127.18.174.194@KRBTEST.COM (short username oryx)
I20260812 11:06:32.858496 32109 webserver.cc:460] Webserver started at http://127.18.174.194:39095/ using document root <none> and password file <none>
I20260812 11:06:32.859086 32109 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:32.859174 32109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:32.863263 32109 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:32.865499 32135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:32.866758 32109 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:06:32.866876 32109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "08e884e163254639b724b04debf66e1c"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "d61d516515f149317d1befc2ae40b6a7"
server_key_iv: "4045b545ebe5992e23b04c829a6adca4"
server_key_version: "encryptionkey@0"
I20260812 11:06:32.867455 32109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:32.886739 32109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:32.890129 32109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:32.890322 32109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:32.890947 32109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:32.891884 32109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:32.891934 32109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:32.892000 32109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:32.892024 32109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:32.901078 32109 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:44457
I20260812 11:06:32.901149 32327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:44457 every 8 connection(s)
I20260812 11:06:32.902145 32109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:06:32.907553 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 32109
I20260812 11:06:32.907755 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 30942
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532792, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
I20260812 11:06:32.925028 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.904159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:45621 (local address 127.18.174.254:36209)
0812 11:06:32.904304 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.904309 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.905326 (+ 1017us) server_negotiation.cc:407] Connection header received
0812 11:06:32.906533 (+ 1207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.906537 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.906597 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.906672 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.915666 (+ 8994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.916272 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.917596 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.917822 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.917918 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.920661 (+ 2743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.920666 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.920668 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.920699 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.922279 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.922970 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.922975 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.922977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.923102 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.923542 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.923546 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.923548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.923828 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.923936 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.924716 (+ 780us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.924851 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532792, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.253@KRBTEST.COM
I20260812 11:06:32.926249 32340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.904635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.194:45621)
0812 11:06:32.905156 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.905213 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.906329 (+ 1116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.906863 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.906870 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.907316 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.915427 (+ 8111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.915461 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.916454 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.916457 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.917440 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.917454 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.917994 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.917999 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.918201 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.918806 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.918824 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.920455 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.922434 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.922441 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.922459 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.922823 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.923206 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.923209 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.923211 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.923412 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.923992 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.923998 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.924383 (+ 385us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.924624 (+ 241us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.925037 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":35,"spinlock_wait_cycles":69248,"thread_start_us":149,"threads_started":1}
I20260812 11:06:32.927652 32329 heartbeater.cc:347] Connected to a master server at 127.18.174.254:36209
I20260812 11:06:32.927947 32329 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:32.928663 32329 heartbeater.cc:511] Master 127.18.174.254:36209 requested a full tablet report, sending...
I20260812 11:06:32.929394 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:33147
--local_ip_for_outbound_sockets=127.18.174.195
--tserver_master_addrs=127.18.174.254:36209
--webserver_port=34783
--webserver_interface=127.18.174.195
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.195.keytab
--principal=oryx/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:42161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.18.174.254:36209,127.18.174.253:34451
--tserver_master_addrs=127.18.174.254:36209,127.18.174.253:34451,127.18.174.252:46007 with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:06:32.930114 31678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.904273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:45611 (local address 127.18.174.253:34451)
0812 11:06:32.904430 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.904435 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.905342 (+ 907us) server_negotiation.cc:407] Connection header received
0812 11:06:32.906571 (+ 1229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.906575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.906633 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.906703 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.921491 (+ 14788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.922141 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.922996 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.923318 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.923387 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.926014 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.926019 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.926022 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.926057 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.928129 (+ 2072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.928656 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.928660 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.928662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.928755 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.929076 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.929080 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.929081 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.929327 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.929436 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.929818 (+ 382us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.929948 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 11:06:32.930323 30335 ts_manager.cc:194] Re-registered known tserver with Master: 08e884e163254639b724b04debf66e1c (127.18.174.194:44457)
I20260812 11:06:32.930752 32334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.904635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:34451 (local address 127.18.174.194:45611)
0812 11:06:32.905157 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.905214 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.906320 (+ 1106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.906864 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.906876 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.907317 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.921293 (+ 13976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.921308 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.922300 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.922302 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.922850 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.922857 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.923554 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.923558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.923666 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.924220 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.924237 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.925821 (+ 1584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.928275 (+ 2454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.928278 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.928280 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.928531 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.928866 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.928869 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.928871 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.928960 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.929502 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.929505 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.929606 (+ 101us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.930317 (+ 711us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.930562 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":118,"spinlock_wait_cycles":105984,"thread_start_us":126,"threads_started":1}
I20260812 11:06:32.931166 30335 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:45621
I20260812 11:06:32.932128 32331 heartbeater.cc:347] Connected to a master server at 127.18.174.253:34451
I20260812 11:06:32.932242 32331 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:32.932485 32331 heartbeater.cc:511] Master 127.18.174.253:34451 requested a full tablet report, sending...
I20260812 11:06:32.933363 31442 ts_manager.cc:194] Registered new tserver with Master: 08e884e163254639b724b04debf66e1c (127.18.174.194:44457)
Aug 12 11:06:32 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532792, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.252@KRBTEST.COM
I20260812 11:06:32.940333 32341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.905716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:46007 (local address 127.18.174.194:39711)
0812 11:06:32.905991 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.906007 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.906330 (+ 323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.906864 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.906876 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.907317 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:32.928230 (+ 20913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.928244 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.930110 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.930113 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.931336 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.931349 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.934186 (+ 2837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.934190 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.934315 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.934852 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:32.934868 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:32.936477 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:32.938739 (+ 2262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.938742 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.938744 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.938986 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.939291 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:32.939293 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:32.939294 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:32.939365 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:32.939796 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:32.939798 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:32.939886 (+ 88us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.939959 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.940172 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":49,"thread_start_us":77,"threads_started":1}
I20260812 11:06:32.940420 32108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.906064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:39711 (local address 127.18.174.252:46007)
0812 11:06:32.906183 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.906187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.906200 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:06:32.906572 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.906575 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.906634 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.906692 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:32.928459 (+ 21767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.929317 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.931494 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.931881 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.931999 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.936690 (+ 4691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:32.936695 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:32.936698 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:32.936737 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:32.938609 (+ 1872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.939091 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.939095 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.939097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.939204 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:32.939443 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:32.939446 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:32.939448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:32.939709 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:32.939821 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.940049 (+ 228us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.940251 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:06:32.941196 32328 heartbeater.cc:347] Connected to a master server at 127.18.174.252:46007
I20260812 11:06:32.941308 32328 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:32.941551 32328 heartbeater.cc:511] Master 127.18.174.252:46007 requested a full tablet report, sending...
I20260812 11:06:32.942340 31785 ts_manager.cc:194] Registered new tserver with Master: 08e884e163254639b724b04debf66e1c (127.18.174.194:44457)
I20260812 11:06:32.988168 32343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.984012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:46007 (local address 127.0.0.1:57872)
0812 11:06:32.984365 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:32.984379 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:32.984523 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:32.984834 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:32.984836 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:32.984849 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:32.984962 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.984968 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.985947 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.985950 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.986813 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:32.986825 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.987769 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.987773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:32.987851 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.987874 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:06:32.987923 (+ 49us) client_negotiation.cc:240] Negotiation successful
0812 11:06:32.987990 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":107,"threads_started":1}
I20260812 11:06:32.988209 32108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:32.984190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57872 (local address 127.18.174.252:46007)
0812 11:06:32.984339 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:32.984345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:32.984467 (+ 122us) server_negotiation.cc:407] Connection header received
0812 11:06:32.984623 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:32.984627 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:32.984700 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:32.984818 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:32.985069 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.985845 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.986947 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:32.987647 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:32.987777 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:32.987932 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:32.987967 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 11:06:32.988049 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:06:32.988912 31794 raft_consensus.cc:1203] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 11:06:32.989367 31852 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62f6c8a5610b47bb87260c44b13fe041. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } } }
I20260812 11:06:32.989516 31852 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [sys.catalog]: This master's current role is: LEARNER
W20260812 11:06:33.053920 32342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:33.054224 32342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:33.054289 32342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:33.058543 32342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:33.058614 32342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:33.058697 32342 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:06:33.064127 32342 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:42161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.195.keytab
--principal=oryx/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:33147
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=34783
--tserver_master_addrs=127.18.174.254:36209,127.18.174.253:34451,127.18.174.252:46007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:33.065281 32342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:33.066375 32342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:33.076866 32352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:33.076872 32353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:33.076902 32355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:33.076926 32342 server_base.cc:1034] running on GCE node
I20260812 11:06:33.077662 32342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:33.078387 32342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:33.079556 32342 hybrid_clock.cc:648] HybridClock initialized: now 1786532793079520 us; error 45 us; skew 500 ppm
Aug 12 11:06:33 dist-test-slave-lgr5 krb5kdc[30256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532793, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:33.082532 32342 init.cc:377] Logged in from keytab as oryx/127.18.174.195@KRBTEST.COM (short username oryx)
I20260812 11:06:33.083561 32342 webserver.cc:460] Webserver started at http://127.18.174.195:34783/ using document root <none> and password file <none>
I20260812 11:06:33.084172 32342 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:33.084259 32342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:33.088362 32342 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:06:33.090547 32370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:33.091900 32342 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:33.092021 32342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "4141b201e806415bab2a50fc18a98dda"
format_stamp: "Formatted at 2026-08-12 11:06:31 on dist-test-slave-lgr5"
server_key: "4756cff12d9d8a43b114cd056d06ffb2"
server_key_iv: "c2075ed0f36f7be7ad5bd52c0fa581dc"
server_key_version: "encryptionkey@0"
I20260812 11:06:33.092633 32342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:33.111302 32342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:33.114197 32342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:33.114387 32342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:33.115021 32342 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:33.115926 32342 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:33.115984 32342 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:33.116042 32342 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:33.116068 32342 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:33.124675 32342 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:33147
I20260812 11:06:33.124703 32614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:33147 every 8 connection(s)
I20260812 11:06:33.125699 32342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:06:33.127385 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 32342
Aug 12 11:06:33 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532793, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.253@KRBTEST.COM
Aug 12 11:06:33 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532793, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
Aug 12 11:06:33 dist-test-slave-lgr5 krb5kdc[30256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532793, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.252@KRBTEST.COM
I20260812 11:06:33.141737 32637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.129514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47186 (local address 127.18.174.253:34451)
0812 11:06:33.130108 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.130112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.130457 (+ 345us) server_negotiation.cc:407] Connection header received
0812 11:06:33.130502 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.130505 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.130548 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.130622 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:33.131618 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.132736 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.134149 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.134493 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.134584 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.136457 (+ 1873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:33.136461 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:33.136464 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:33.136502 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:33.138724 (+ 2222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.140018 (+ 1294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.140022 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.140024 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.140147 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.140448 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.140452 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.140453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.140680 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:33.140803 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.141411 (+ 608us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.141551 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":69,"threads_started":1}
I20260812 11:06:33.143649 32638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.129657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42728 (local address 127.18.174.254:36209)
0812 11:06:33.131575 (+ 1918us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.131580 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.131594 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:06:33.131630 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.131633 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.131674 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.132603 (+ 929us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:33.132705 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.133429 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.134635 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.134977 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.135791 (+ 814us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.138230 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:33.138235 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:33.138237 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:33.138266 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:33.140168 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.140671 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.140674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.140675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.140766 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.141084 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.141088 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.141089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.141587 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:33.142295 (+ 708us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.143284 (+ 989us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.143468 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1782,"thread_start_us":91,"threads_started":1}
I20260812 11:06:33.147644 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.127520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:38583 (local address 127.18.174.254:36209)
0812 11:06:33.127918 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.127923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.129672 (+ 1749us) server_negotiation.cc:407] Connection header received
0812 11:06:33.129935 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.129939 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.129995 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.130049 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:33.131993 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.132760 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.135627 (+ 2867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.135983 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.136066 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.142737 (+ 6671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:33.142741 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:33.142743 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:33.142768 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:33.144662 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.145480 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.145484 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.145486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.145574 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.146142 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.146145 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.146147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.146409 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:33.146482 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.147376 (+ 894us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.147500 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301}
I20260812 11:06:33.147931 32108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.129276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:42747 (local address 127.18.174.252:46007)
0812 11:06:33.129401 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.129405 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.130829 (+ 1424us) server_negotiation.cc:407] Connection header received
0812 11:06:33.131025 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.131029 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.131086 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.131143 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:33.133682 (+ 2539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.134474 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.135584 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.135892 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.135963 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.141661 (+ 5698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:33.141666 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:33.141668 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:33.141693 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:33.143993 (+ 2300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.145689 (+ 1696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.145692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.145694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.145792 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.146664 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.146668 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.146669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.146882 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:33.146964 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.147592 (+ 628us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.147779 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":52,"spinlock_wait_cycles":1280}
I20260812 11:06:33.148307 32647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.130375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57878 (local address 127.18.174.252:46007)
0812 11:06:33.135543 (+ 5168us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.135548 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.135560 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:06:33.135592 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.135595 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.135644 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.138182 (+ 2538us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:33.138292 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.139202 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.140497 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.140877 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.141309 (+ 432us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.142736 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:33.142740 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:33.142743 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:33.142768 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:33.145539 (+ 2771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.146142 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.146145 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.146147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.146229 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.146586 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.146589 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.146591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.146807 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:33.147465 (+ 658us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.147566 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.147929 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5069,"spinlock_wait_cycles":3456,"thread_start_us":105,"threads_started":1}
I20260812 11:06:33.149094 31678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.127771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:43231 (local address 127.18.174.253:34451)
0812 11:06:33.128139 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.128143 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.128746 (+ 603us) server_negotiation.cc:407] Connection header received
0812 11:06:33.129946 (+ 1200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.129949 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.130008 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.130069 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:33.132375 (+ 2306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.133126 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.135117 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.135392 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.135488 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.142062 (+ 6574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:33.142066 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:33.142068 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:33.142093 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:33.144739 (+ 2646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.145719 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.145722 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.145724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.145799 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.146271 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.146275 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.146276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.146506 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:33.146586 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.148826 (+ 2240us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.148956 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267}
I20260812 11:06:33.149394 32633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.128013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.195:38583)
0812 11:06:33.129579 (+ 1566us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:33.129593 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:33.129748 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:33.130594 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:33.130597 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:33.131119 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:33.131829 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.131851 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.132935 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.132938 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.134361 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.134371 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.136250 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.136254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.136529 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.137263 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:33.137285 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:33.142597 (+ 5312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:33.144801 (+ 2204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:33.144809 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:33.144832 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:33.145359 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:33.145685 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:33.145688 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:33.145690 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:33.145958 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:33.146586 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:33.146593 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:33.147024 (+ 431us) client_negotiation.cc:769] Sending connection context
0812 11:06:33.147794 (+ 770us) client_negotiation.cc:240] Negotiation successful
0812 11:06:33.148219 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1476,"mutex_wait_us":65,"spinlock_wait_cycles":30336,"thread_start_us":135,"threads_started":1}
I20260812 11:06:33.149765 32620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.128014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:34451 (local address 127.18.174.195:43231)
0812 11:06:33.128582 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:33.128636 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:33.129694 (+ 1058us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:33.130564 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:33.130574 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:33.132109 (+ 1535us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:33.132235 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.132243 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.133264 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.133266 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.134994 (+ 1728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.135022 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.137446 (+ 2424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.137453 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.137562 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.138054 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:33.138070 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:33.141492 (+ 3422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:33.145139 (+ 3647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:33.145142 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:33.145144 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:33.145393 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:33.145907 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:33.145909 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:33.145911 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:33.145996 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:33.147028 (+ 1032us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:33.147031 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:33.147120 (+ 89us) client_negotiation.cc:769] Sending connection context
0812 11:06:33.149434 (+ 2314us) client_negotiation.cc:240] Negotiation successful
0812 11:06:33.149596 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":847,"thread_start_us":162,"threads_started":1}
I20260812 11:06:33.147174 30335 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 11:06:33.150532 32623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.129138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:46007 (local address 127.18.174.195:42747)
0812 11:06:33.130743 (+ 1605us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:33.130757 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:33.130899 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:33.131294 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:33.131297 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:33.131631 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:33.131829 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.131850 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.134627 (+ 2777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.134630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.135453 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.135466 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.136209 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.136214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.136724 (+ 510us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.137651 (+ 927us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:33.137668 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:33.141064 (+ 3396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:33.144859 (+ 3795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:33.144862 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:33.144864 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:33.145598 (+ 734us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:33.146083 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:33.146085 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:33.146087 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:33.146160 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:33.147316 (+ 1156us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:33.147319 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:33.147398 (+ 79us) client_negotiation.cc:769] Sending connection context
0812 11:06:33.147678 (+ 280us) client_negotiation.cc:240] Negotiation successful
0812 11:06:33.148328 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1542,"mutex_wait_us":223,"spinlock_wait_cycles":4864,"thread_start_us":82,"threads_started":1}
I20260812 11:06:33.150776 32618 heartbeater.cc:347] Connected to a master server at 127.18.174.253:34451
I20260812 11:06:33.151042 32618 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:33.151101 32615 heartbeater.cc:347] Connected to a master server at 127.18.174.252:46007
I20260812 11:06:33.151198 32615 heartbeater.cc:464] Registering TS with master...
W20260812 11:06:33.151567 30335 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:33.151593 32618 heartbeater.cc:511] Master 127.18.174.253:34451 requested a full tablet report, sending...
I20260812 11:06:33.151594 32615 heartbeater.cc:511] Master 127.18.174.252:46007 requested a full tablet report, sending...
I20260812 11:06:33.152624 32617 heartbeater.cc:347] Connected to a master server at 127.18.174.254:36209
I20260812 11:06:33.152715 32617 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:33.152740 31442 ts_manager.cc:194] Registered new tserver with Master: 4141b201e806415bab2a50fc18a98dda (127.18.174.195:33147)
I20260812 11:06:33.152870 32617 heartbeater.cc:511] Master 127.18.174.254:36209 requested a full tablet report, sending...
I20260812 11:06:33.152870 31785 ts_manager.cc:194] Registered new tserver with Master: 4141b201e806415bab2a50fc18a98dda (127.18.174.195:33147)
I20260812 11:06:33.153627 30334 ts_manager.cc:194] Re-registered known tserver with Master: 4141b201e806415bab2a50fc18a98dda (127.18.174.195:33147)
I20260812 11:06:33.154377 30334 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:38583
I20260812 11:06:33.155546 31363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: NON_VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: true } } }
I20260812 11:06:33.155679 31363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:33.159404 32652 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041: attempting to promote NON_VOTER bcae5fbb46344be18522cd8f928c4d8d to VOTER
I20260812 11:06:33.159770 32652 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } }
I20260812 11:06:33.161005 31464 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 1 FOLLOWER]: Refusing update from remote peer 62f6c8a5610b47bb87260c44b13fe041: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 11:06:33.161170 31794 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 1 LEARNER]: Refusing update from remote peer 62f6c8a5610b47bb87260c44b13fe041: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 11:06:33.161502 31363 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 11:06:33.161988 31363 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 11:06:33.163558 31363 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, bcae5fbb46344be18522cd8f928c4d8d (127.18.174.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } } }
I20260812 11:06:33.164240 31464 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, bcae5fbb46344be18522cd8f928c4d8d (127.18.174.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } } }
I20260812 11:06:33.165030 32667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } } }
I20260812 11:06:33.165150 32667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:33.165665 31794 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, bcae5fbb46344be18522cd8f928c4d8d (127.18.174.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } } }
I20260812 11:06:33.166205 32673 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } } }
I20260812 11:06:33.166342 32673 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:06:33.167475 31852 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } } }
I20260812 11:06:33.167585 31852 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:06:33.167759 31363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } } }
I20260812 11:06:33.167869 31363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:33.167973 32667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "62f6c8a5610b47bb87260c44b13fe041" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } } }
I20260812 11:06:33.168071 32667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:33.175455 32343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.169512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:44457 (local address 127.0.0.1:59458)
0812 11:06:33.170026 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:33.170041 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:33.170120 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:33.171300 (+ 1180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:33.171303 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:33.171323 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:33.171417 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.171421 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.172650 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.172654 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.173903 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.173915 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.175070 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.175073 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.175162 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.175191 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 11:06:33.175238 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 11:06:33.175314 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"mutex_wait_us":23}
I20260812 11:06:33.175733 32682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.169728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:34803 (local address 127.0.0.1:35680)
0812 11:06:33.170286 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:33.170299 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:33.170390 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:33.171940 (+ 1550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:33.171943 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:33.171961 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:33.172054 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.172060 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.173347 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.173351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.174352 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.174362 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.175168 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.175172 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.175453 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.175470 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 11:06:33.175522 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 11:06:33.175595 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"mutex_wait_us":26,"thread_start_us":123,"threads_started":1}
I20260812 11:06:33.176216 32676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.169888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35680 (local address 127.18.174.193:34803)
0812 11:06:33.171574 (+ 1686us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.171588 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.171606 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:06:33.171667 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.171670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.171814 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.171945 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:33.172283 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.173250 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.174487 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.175050 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.175168 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.175323 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.175778 (+ 455us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.176053 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1594,"thread_start_us":84,"threads_started":1}
I20260812 11:06:33.176595 32675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.169714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59458 (local address 127.18.174.194:44457)
0812 11:06:33.170801 (+ 1087us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.170811 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.170831 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:06:33.170913 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.170919 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.171164 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.171326 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:33.171533 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.172524 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.174049 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.174911 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.175771 (+ 860us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.175908 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.175959 (+ 51us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.176050 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":993,"thread_start_us":134,"threads_started":1}
I20260812 11:06:33.176751 32674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.170046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:33147 (local address 127.0.0.1:45960)
0812 11:06:33.170488 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:33.170500 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:33.170572 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:33.172729 (+ 2157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:33.172732 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:33.172752 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:33.172878 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.172884 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.174198 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.174201 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.175312 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.175321 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.176386 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.176389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.176484 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.176510 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:06:33.176560 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 11:06:33.176626 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"mutex_wait_us":46,"thread_start_us":96,"threads_started":1}
I20260812 11:06:33.177434 32683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.170477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45960 (local address 127.18.174.195:33147)
0812 11:06:33.172285 (+ 1808us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.172297 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.172317 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:06:33.172413 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.172418 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.172600 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.172751 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:33.172998 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.174081 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.175422 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.176248 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.177035 (+ 787us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.177159 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.177206 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.177292 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1694,"thread_start_us":125,"threads_started":1}
I20260812 11:06:33.179440 32218 tablet_service.cc:1467] Processing CreateTablet for tablet 476d7adb4dd94c60891fc1d90ccc22ad (DEFAULT_TABLE table=test-table [id=df67e927734942598d037a2c638c34aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:33.179438 31982 tablet_service.cc:1467] Processing CreateTablet for tablet 476d7adb4dd94c60891fc1d90ccc22ad (DEFAULT_TABLE table=test-table [id=df67e927734942598d037a2c638c34aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:33.180055 32470 tablet_service.cc:1467] Processing CreateTablet for tablet 476d7adb4dd94c60891fc1d90ccc22ad (DEFAULT_TABLE table=test-table [id=df67e927734942598d037a2c638c34aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:33.180486 32218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 476d7adb4dd94c60891fc1d90ccc22ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:33.180544 31982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 476d7adb4dd94c60891fc1d90ccc22ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:33.181041 32470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 476d7adb4dd94c60891fc1d90ccc22ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:33.189698 32696 tablet_bootstrap.cc:492] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c: Bootstrap starting.
I20260812 11:06:33.192117 32696 tablet_bootstrap.cc:654] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:33.192476 32694 tablet_bootstrap.cc:492] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda: Bootstrap starting.
I20260812 11:06:33.193032 32696 log.cc:824] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:33.194531 32694 tablet_bootstrap.cc:654] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:33.195212 32696 tablet_bootstrap.cc:492] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c: No bootstrap required, opened a new log
I20260812 11:06:33.195273 32694 log.cc:824] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:33.195395 32696 ts_tablet_manager.cc:1397] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:06:33.196004 32688 tablet_bootstrap.cc:492] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068: Bootstrap starting.
I20260812 11:06:33.197502 32694 tablet_bootstrap.cc:492] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda: No bootstrap required, opened a new log
I20260812 11:06:33.197705 32694 ts_tablet_manager.cc:1397] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 11:06:33.198132 32688 tablet_bootstrap.cc:654] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:33.198908 32688 log.cc:824] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:33.200014 32696 raft_consensus.cc:348] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } } peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } }
I20260812 11:06:33.200335 32696 raft_consensus.cc:374] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:33.200398 32696 raft_consensus.cc:729] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e884e163254639b724b04debf66e1c, State: Initialized, Role: FOLLOWER
I20260812 11:06:33.200848 32688 tablet_bootstrap.cc:492] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068: No bootstrap required, opened a new log
I20260812 11:06:33.200883 32696 consensus_queue.cc:260] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } } peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } }
I20260812 11:06:33.201045 32688 ts_tablet_manager.cc:1397] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:06:33.202167 32696 ts_tablet_manager.cc:1428] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260812 11:06:33.202371 32329 heartbeater.cc:503] Master 127.18.174.254:36209 was elected leader, sending a full tablet report...
I20260812 11:06:33.202299 32694 raft_consensus.cc:348] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } } peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } }
I20260812 11:06:33.202544 32694 raft_consensus.cc:374] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:33.202592 32694 raft_consensus.cc:729] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4141b201e806415bab2a50fc18a98dda, State: Initialized, Role: FOLLOWER
I20260812 11:06:33.204743 32688 raft_consensus.cc:348] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } } peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } }
I20260812 11:06:33.205005 32688 raft_consensus.cc:374] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:33.205060 32688 raft_consensus.cc:729] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4721022f36a84a28b9502b8310486068, State: Initialized, Role: FOLLOWER
I20260812 11:06:33.205525 32694 consensus_queue.cc:260] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } } peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } }
I20260812 11:06:33.205718 32688 consensus_queue.cc:260] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } } peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } }
I20260812 11:06:33.206579 32694 ts_tablet_manager.cc:1428] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260812 11:06:33.206658 32688 ts_tablet_manager.cc:1428] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:06:33.206962 32617 heartbeater.cc:503] Master 127.18.174.254:36209 was elected leader, sending a full tablet report...
I20260812 11:06:33.207226 32098 heartbeater.cc:503] Master 127.18.174.254:36209 was elected leader, sending a full tablet report...
I20260812 11:06:33.361959 32710 raft_consensus.cc:482] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:33.362185 32710 raft_consensus.cc:504] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } } peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } }
I20260812 11:06:33.363489 32710 leader_election.cc:288] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08e884e163254639b724b04debf66e1c (127.18.174.194:44457), 4141b201e806415bab2a50fc18a98dda (127.18.174.195:33147)
I20260812 11:06:33.367527 32683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.364052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:53955 (local address 127.18.174.195:33147)
0812 11:06:33.364195 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.364200 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.364285 (+ 85us) server_negotiation.cc:407] Connection header received
0812 11:06:33.364444 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.364447 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.364506 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.364556 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:33.364905 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.365392 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.366552 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.366961 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.367081 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.367133 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.367325 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.367399 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 11:06:33.367535 32675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.363863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:56927 (local address 127.18.174.194:44457)
0812 11:06:33.364153 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.364158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.364176 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:06:33.364378 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.364381 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.364436 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.364514 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:33.364801 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.365374 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.366556 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.366950 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.367067 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.367127 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.367331 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.367411 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171}
I20260812 11:06:33.367590 32712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.363655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:44457 (local address 127.18.174.193:56927)
0812 11:06:33.364098 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:33.364114 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:33.364223 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:33.364543 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:33.364547 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:33.364576 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:33.364695 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.364702 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.365496 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.365500 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.366419 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.366430 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.367067 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.367071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.367216 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.367236 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:06:33.367300 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 11:06:33.367380 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":104,"thread_start_us":76,"threads_started":1}
I20260812 11:06:33.367750 32713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.363753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:33147 (local address 127.18.174.193:53955)
0812 11:06:33.364187 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:33.364200 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:33.364307 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:33.364692 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:33.364694 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:33.364708 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:33.364795 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.364801 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.365511 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.365515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.366416 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:33.366426 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.367083 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.367086 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:33.367201 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.367230 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 11:06:33.367293 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 11:06:33.367374 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"mutex_wait_us":19,"thread_start_us":144,"threads_started":1}
I20260812 11:06:33.368376 32255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "476d7adb4dd94c60891fc1d90ccc22ad" candidate_uuid: "4721022f36a84a28b9502b8310486068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e884e163254639b724b04debf66e1c" is_pre_election: true
I20260812 11:06:33.368400 32521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "476d7adb4dd94c60891fc1d90ccc22ad" candidate_uuid: "4721022f36a84a28b9502b8310486068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4141b201e806415bab2a50fc18a98dda" is_pre_election: true
I20260812 11:06:33.368682 32521 raft_consensus.cc:2454] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4721022f36a84a28b9502b8310486068 in term 0.
I20260812 11:06:33.368700 32255 raft_consensus.cc:2454] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4721022f36a84a28b9502b8310486068 in term 0.
I20260812 11:06:33.369164 31906 leader_election.cc:302] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4141b201e806415bab2a50fc18a98dda, 4721022f36a84a28b9502b8310486068; no voters:
I20260812 11:06:33.369444 32710 raft_consensus.cc:2781] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:33.369529 32710 raft_consensus.cc:482] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:33.369562 32710 raft_consensus.cc:3037] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:33.370687 32710 raft_consensus.cc:504] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } } peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } }
I20260812 11:06:33.371063 32710 leader_election.cc:288] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [CANDIDATE]: Term 1 election: Requested vote from peers 08e884e163254639b724b04debf66e1c (127.18.174.194:44457), 4141b201e806415bab2a50fc18a98dda (127.18.174.195:33147)
I20260812 11:06:33.371397 32255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "476d7adb4dd94c60891fc1d90ccc22ad" candidate_uuid: "4721022f36a84a28b9502b8310486068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e884e163254639b724b04debf66e1c"
I20260812 11:06:33.371508 32521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "476d7adb4dd94c60891fc1d90ccc22ad" candidate_uuid: "4721022f36a84a28b9502b8310486068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4141b201e806415bab2a50fc18a98dda"
I20260812 11:06:33.371528 32255 raft_consensus.cc:3037] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:33.371663 32521 raft_consensus.cc:3037] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:33.372692 32255 raft_consensus.cc:2454] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4721022f36a84a28b9502b8310486068 in term 1.
I20260812 11:06:33.372860 32521 raft_consensus.cc:2454] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4721022f36a84a28b9502b8310486068 in term 1.
I20260812 11:06:33.373065 31909 leader_election.cc:302] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e884e163254639b724b04debf66e1c, 4721022f36a84a28b9502b8310486068; no voters:
I20260812 11:06:33.373265 32710 raft_consensus.cc:2781] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:33.373489 32710 raft_consensus.cc:686] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [term 1 LEADER]: Becoming Leader. State: Replica: 4721022f36a84a28b9502b8310486068, State: Running, Role: LEADER
I20260812 11:06:33.373881 32710 consensus_queue.cc:237] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } } peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } }
W20260812 11:06:33.376925 32619 tablet.cc:2369] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:06:33.377665 30335 catalog_manager.cc:5495] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4721022f36a84a28b9502b8310486068 (127.18.174.193). New cstate: current_term: 1 leader_uuid: "4721022f36a84a28b9502b8310486068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } health_report { overall_health: UNKNOWN } } }
W20260812 11:06:33.404392 32333 tablet.cc:2369] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:06:33.415794 32102 tablet.cc:2369] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:06:33.418535 32676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.415067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35692 (local address 127.18.174.193:34803)
0812 11:06:33.415194 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.415198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.415211 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:06:33.415296 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.415298 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.415356 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.415447 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:33.415662 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.416401 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.417247 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.417455 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.417533 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.417766 (+ 233us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:33.418228 (+ 462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:33.418320 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.418351 (+ 31us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.418406 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:06:33.424816 32521 raft_consensus.cc:1261] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda [term 1 FOLLOWER]: Refusing update from remote peer 4721022f36a84a28b9502b8310486068: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:33.424816 32255 raft_consensus.cc:1261] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c [term 1 FOLLOWER]: Refusing update from remote peer 4721022f36a84a28b9502b8310486068: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:33.425700 32719 consensus_queue.cc:1035] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:33.425908 32710 consensus_queue.cc:1035] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:33.436180 32725 mvcc.cc:205] Tried to move back new op lower bound from 7317638321859719168 to 7317638321662287872. Current Snapshot: MvccSnapshot[applied={T|T < 7317638321859719168}]
I20260812 11:06:33.438223 32727 mvcc.cc:205] Tried to move back new op lower bound from 7317638321859719168 to 7317638321662287872. Current Snapshot: MvccSnapshot[applied={T|T < 7317638321859719168}]
I20260812 11:06:33.440882 32723 mvcc.cc:205] Tried to move back new op lower bound from 7317638321859719168 to 7317638321662287872. Current Snapshot: MvccSnapshot[applied={T|T < 7317638321859719168 or (T in {7317638321859719168})}]
I20260812 11:06:33.447446 30334 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:33.447662 30334 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:33.452381 30334 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 62f6c8a5610b47bb87260c44b13fe041: Sending DeleteTablet for 3 replicas of tablet 476d7adb4dd94c60891fc1d90ccc22ad
I20260812 11:06:33.453320 32218 tablet_service.cc:1514] Processing DeleteTablet for tablet 476d7adb4dd94c60891fc1d90ccc22ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:33 UTC) from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:59458
I20260812 11:06:33.453365 31982 tablet_service.cc:1514] Processing DeleteTablet for tablet 476d7adb4dd94c60891fc1d90ccc22ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:33 UTC) from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:35680
I20260812 11:06:33.453779 32470 tablet_service.cc:1514] Processing DeleteTablet for tablet 476d7adb4dd94c60891fc1d90ccc22ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:33 UTC) from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:45960
I20260812 11:06:33.453902 32739 tablet_replica.cc:330] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c: stopping tablet replica
I20260812 11:06:33.454291 32739 raft_consensus.cc:2229] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:33.454664 32739 raft_consensus.cc:2258] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:33.454862 32740 tablet_replica.cc:330] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068: stopping tablet replica
I20260812 11:06:33.455271 32740 raft_consensus.cc:2229] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:06:33.455787 32740 raft_consensus.cc:2258] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:33.456876 32739 ts_tablet_manager.cc:1905] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:33.457028 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 30286
I20260812 11:06:33.467568 32739 ts_tablet_manager.cc:1918] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:33.467711 32739 log.cc:1196] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/476d7adb4dd94c60891fc1d90ccc22ad
I20260812 11:06:33.468116 32739 ts_tablet_manager.cc:1939] T 476d7adb4dd94c60891fc1d90ccc22ad P 08e884e163254639b724b04debf66e1c: Deleting consensus metadata
I20260812 11:06:33.469117 32740 ts_tablet_manager.cc:1905] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:33.471966 32740 ts_tablet_manager.cc:1918] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:33.472119 32740 log.cc:1196] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-0/wal/wals/476d7adb4dd94c60891fc1d90ccc22ad
I20260812 11:06:33.472461 32740 ts_tablet_manager.cc:1939] T 476d7adb4dd94c60891fc1d90ccc22ad P 4721022f36a84a28b9502b8310486068: Deleting consensus metadata
I20260812 11:06:33.474148 32741 tablet_replica.cc:330] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda: stopping tablet replica
I20260812 11:06:33.474561 32741 raft_consensus.cc:2229] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:33.474933 32741 raft_consensus.cc:2258] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 11:06:33.476732 31909 connection.cc:535] server connection from 127.0.0.1:35680 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 11:06:33.476882 32741 ts_tablet_manager.cc:1905] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 11:06:33.477299 32138 connection.cc:535] server connection from 127.0.0.1:59458 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 11:06:33.480001 32741 ts_tablet_manager.cc:1918] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:33.480157 32741 log.cc:1196] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/476d7adb4dd94c60891fc1d90ccc22ad
I20260812 11:06:33.480507 32741 ts_tablet_manager.cc:1939] T 476d7adb4dd94c60891fc1d90ccc22ad P 4141b201e806415bab2a50fc18a98dda: Deleting consensus metadata
W20260812 11:06:33.481629 32371 connection.cc:441] server connection from 127.0.0.1:45960 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45960 (request call id 1) could send its response
I20260812 11:06:33.486370 31678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.455656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47200 (local address 127.18.174.253:34451)
0812 11:06:33.455766 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.455771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.456344 (+ 573us) server_negotiation.cc:407] Connection header received
0812 11:06:33.473971 (+ 17627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.473975 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.474045 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.474138 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:33.475589 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.476458 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.478003 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.478367 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.478457 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.482560 (+ 4103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:33.482564 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:33.482566 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:33.482594 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:33.483965 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.484556 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.484560 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.484562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.484663 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.484999 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.485002 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.485004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.485253 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:33.485400 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.486040 (+ 640us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.486176 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:06:33.494961 32637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.485416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47216 (local address 127.18.174.253:34451)
0812 11:06:33.485543 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.485547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.486053 (+ 506us) server_negotiation.cc:407] Connection header received
0812 11:06:33.486158 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.486160 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.486201 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.486258 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:33.487093 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.487890 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.489028 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.489383 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.489459 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.491241 (+ 1782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:33.491245 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:33.491248 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:33.491277 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:33.492988 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.493464 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.493468 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.493470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.493562 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.493885 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.493889 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.493890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.494121 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:33.494232 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.494633 (+ 401us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.494769 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:06:33.496511 32647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.455531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57882 (local address 127.18.174.252:46007)
0812 11:06:33.455747 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.455753 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.486944 (+ 31191us) server_negotiation.cc:407] Connection header received
0812 11:06:33.487055 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.487058 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.487112 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.487178 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:33.488006 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.488833 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.489957 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.490262 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.490376 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.492728 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:33.492732 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:33.492735 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:33.492763 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:33.494526 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.494955 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.494958 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.494960 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.495067 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.495397 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.495400 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.495402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.495657 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:33.495758 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.496166 (+ 408us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.496294 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260812 11:06:33.497395 32108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:33.484948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57896 (local address 127.18.174.252:46007)
0812 11:06:33.485097 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:33.485101 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:33.487171 (+ 2070us) server_negotiation.cc:407] Connection header received
0812 11:06:33.487375 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:33.487378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:33.487432 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:33.487491 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:33.488561 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.489335 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.490970 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:33.491333 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:33.491414 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:33.493100 (+ 1686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:33.493105 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:33.493107 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:33.493139 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:33.495320 (+ 2181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.495908 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.495912 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.495914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.496006 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:33.496438 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:33.496441 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:33.496443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:33.496674 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:33.496796 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:33.497092 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 11:06:33.497215 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:06:34.440263 32758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:34.439268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.194:57277)
0812 11:06:34.440012 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:34.440144 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":89,"threads_started":1}
W20260812 11:06:34.440598 32329 heartbeater.cc:644] Failed to heartbeat to 127.18.174.254:36209 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
I20260812 11:06:34.441597 32765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:34.441227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.195:52409)
0812 11:06:34.441447 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:34.441519 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":69,"threads_started":1}
I20260812 11:06:34.441619 32760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:34.441158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.193:36329)
0812 11:06:34.441433 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:34.441536 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":69,"threads_started":1}
W20260812 11:06:34.441867 32617 heartbeater.cc:644] Failed to heartbeat to 127.18.174.254:36209 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
W20260812 11:06:34.441895 32098 heartbeater.cc:644] Failed to heartbeat to 127.18.174.254:36209 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
I20260812 11:06:34.953466 300 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 62f6c8a5610b47bb87260c44b13fe041)
I20260812 11:06:34.953490 32766 raft_consensus.cc:482] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 62f6c8a5610b47bb87260c44b13fe041)
I20260812 11:06:34.953729 32766 raft_consensus.cc:504] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } }
I20260812 11:06:34.953729 300 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } }
I20260812 11:06:34.954962 300 leader_election.cc:288] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 62f6c8a5610b47bb87260c44b13fe041 (127.18.174.254:36209), bcae5fbb46344be18522cd8f928c4d8d (127.18.174.252:46007)
I20260812 11:06:34.954977 32766 leader_election.cc:288] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 62f6c8a5610b47bb87260c44b13fe041 (127.18.174.254:36209), f5ac7cfd948b493f88ae0d14539b25e7 (127.18.174.253:34451)
I20260812 11:06:34.955749 303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:34.955175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.0.0.1:43200)
0812 11:06:34.955536 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:34.955627 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":24,"thread_start_us":60,"threads_started":1}
I20260812 11:06:34.955756 308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:34.955356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.0.0.1:43202)
0812 11:06:34.955580 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:34.955656 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":59,"threads_started":1}
W20260812 11:06:34.955940 31754 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
W20260812 11:06:34.956053 31418 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
I20260812 11:06:34.956897 303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:34.956539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.0.0.1:43218)
0812 11:06:34.956721 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:34.956771 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260812 11:06:34.957396 308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:34.957163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.0.0.1:43234)
0812 11:06:34.957288 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:34.957332 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260812 11:06:34.957492 31418 leader_election.cc:334] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 62f6c8a5610b47bb87260c44b13fe041 (127.18.174.254:36209): Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
W20260812 11:06:34.957724 31754 leader_election.cc:334] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 62f6c8a5610b47bb87260c44b13fe041 (127.18.174.254:36209): Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
I20260812 11:06:34.959942 305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:34.955175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:34451 (local address 127.0.0.1:47232)
0812 11:06:34.955511 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:34.955526 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:34.955643 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:34.956372 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:34.956376 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:34.956401 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:34.956524 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:34.956530 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:34.957622 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:34.957626 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:34.958697 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:34.958709 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:34.959626 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:34.959629 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:34.959704 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:34.959728 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:06:34.959785 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 11:06:34.959843 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":71,"threads_started":1}
I20260812 11:06:34.959967 314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:34.955837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47232 (local address 127.18.174.253:34451)
0812 11:06:34.956060 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:34.956065 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:34.956105 (+ 40us) server_negotiation.cc:407] Connection header received
0812 11:06:34.956161 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:34.956164 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:34.956211 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:34.956642 (+ 431us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:34.956753 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:34.957489 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:34.958849 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:34.959500 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:34.959609 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:34.959656 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:34.959804 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 11:06:34.959860 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":162,"thread_start_us":63,"threads_started":1}
I20260812 11:06:34.960441 31464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bcae5fbb46344be18522cd8f928c4d8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" is_pre_election: true
I20260812 11:06:34.960645 31464 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcae5fbb46344be18522cd8f928c4d8d in term 1.
I20260812 11:06:34.961016 31755 leader_election.cc:302] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bcae5fbb46344be18522cd8f928c4d8d, f5ac7cfd948b493f88ae0d14539b25e7; no voters: 62f6c8a5610b47bb87260c44b13fe041
I20260812 11:06:34.961081 310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:34.955650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:46007 (local address 127.0.0.1:57904)
0812 11:06:34.955855 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:34.955869 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:34.955969 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:34.957120 (+ 1151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:34.957124 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:34.957143 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:34.957243 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:34.957249 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:34.958229 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:34.958233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:34.959491 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:34.959499 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:34.960687 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:34.960690 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:34.960783 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:34.960804 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 11:06:34.960870 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 11:06:34.960938 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":48,"thread_start_us":69,"threads_started":1}
I20260812 11:06:34.961105 318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:34.956639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57904 (local address 127.18.174.252:46007)
0812 11:06:34.956878 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:34.956887 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:34.956901 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:06:34.956944 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:34.956947 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:34.956999 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:34.957336 (+ 337us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:34.957427 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:34.958113 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:34.960110 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:34.960579 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:34.960688 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:34.960736 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:34.960893 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 11:06:34.960960 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":105,"threads_started":1}
I20260812 11:06:34.961259 32766 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 11:06:34.961304 32766 raft_consensus.cc:482] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 62f6c8a5610b47bb87260c44b13fe041)
I20260812 11:06:34.961330 32766 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:06:34.961683 31794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bcae5fbb46344be18522cd8f928c4d8d" is_pre_election: true
I20260812 11:06:34.962430 32766 raft_consensus.cc:504] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } }
I20260812 11:06:34.962678 31794 raft_consensus.cc:2379] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5ac7cfd948b493f88ae0d14539b25e7 in current term 2: Already voted for candidate bcae5fbb46344be18522cd8f928c4d8d in this term.
I20260812 11:06:34.962829 32766 leader_election.cc:288] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [CANDIDATE]: Term 2 election: Requested vote from peers 62f6c8a5610b47bb87260c44b13fe041 (127.18.174.254:36209), f5ac7cfd948b493f88ae0d14539b25e7 (127.18.174.253:34451)
I20260812 11:06:34.963125 305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:34.962916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.0.0.1:43242)
0812 11:06:34.963013 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:34.963066 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 11:06:34.963181 31464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bcae5fbb46344be18522cd8f928c4d8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f5ac7cfd948b493f88ae0d14539b25e7"
I20260812 11:06:34.963289 31418 leader_election.cc:302] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5ac7cfd948b493f88ae0d14539b25e7; no voters: 62f6c8a5610b47bb87260c44b13fe041, bcae5fbb46344be18522cd8f928c4d8d
I20260812 11:06:34.963305 31464 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:06:34.963810 305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:34.963596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.0.0.1:43254)
0812 11:06:34.963723 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:34.963762 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260812 11:06:34.963912 31754 leader_election.cc:334] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 62f6c8a5610b47bb87260c44b13fe041 (127.18.174.254:36209): Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
I20260812 11:06:34.964471 31464 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcae5fbb46344be18522cd8f928c4d8d in term 2.
I20260812 11:06:34.964589 300 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:06:34.964772 31755 leader_election.cc:302] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bcae5fbb46344be18522cd8f928c4d8d, f5ac7cfd948b493f88ae0d14539b25e7; no voters: 62f6c8a5610b47bb87260c44b13fe041
I20260812 11:06:34.964975 32766 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:06:34.965159 32766 raft_consensus.cc:686] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [term 2 LEADER]: Becoming Leader. State: Replica: bcae5fbb46344be18522cd8f928c4d8d, State: Running, Role: LEADER
I20260812 11:06:34.965399 32766 consensus_queue.cc:237] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } }
I20260812 11:06:34.966763 320 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcae5fbb46344be18522cd8f928c4d8d. Latest consensus state: current_term: 2 leader_uuid: "bcae5fbb46344be18522cd8f928c4d8d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } } }
I20260812 11:06:34.966876 320 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:34.967171 325 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:34.969728 325 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:34.970144 325 catalog_manager.cc:1259] Loaded cluster ID: 50ee3a6bda774d0fad714ef7f751cf36
I20260812 11:06:34.970196 325 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:34.970822 325 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:34.971242 325 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: Loaded TSK: 0
I20260812 11:06:34.971990 325 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:06:35.023342 31783 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57896:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:06:35.026548 31783 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:35.029681 305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.029413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.0.0.1:43284)
0812 11:06:35.029530 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.029596 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 11:06:35.029814 31464 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [term 2 FOLLOWER]: Refusing update from remote peer bcae5fbb46344be18522cd8f928c4d8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260812 11:06:35.030346 305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.030126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.0.0.1:43286)
0812 11:06:35.030238 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.030288 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 11:06:35.030390 320 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260812 11:06:35.030594 31754 consensus_peers.cc:487] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d -> Peer 62f6c8a5610b47bb87260c44b13fe041 (127.18.174.254:36209): Couldn't send request to peer 62f6c8a5610b47bb87260c44b13fe041. Status: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 11:06:35.031955 300 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcae5fbb46344be18522cd8f928c4d8d. Latest consensus state: current_term: 2 leader_uuid: "bcae5fbb46344be18522cd8f928c4d8d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } } }
I20260812 11:06:35.032123 300 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:06:35.033253 32766 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "bcae5fbb46344be18522cd8f928c4d8d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } } }
I20260812 11:06:35.033381 32766 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:35.033823 300 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "bcae5fbb46344be18522cd8f928c4d8d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "62f6c8a5610b47bb87260c44b13fe041" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36209 } } peers { permanent_uuid: "f5ac7cfd948b493f88ae0d14539b25e7" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 34451 } attrs { promote: false } } peers { permanent_uuid: "bcae5fbb46344be18522cd8f928c4d8d" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 46007 } attrs { promote: false } } }
I20260812 11:06:35.033941 300 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ac7cfd948b493f88ae0d14539b25e7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:06:35.043000 305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.038937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:34803 (local address 127.0.0.1:35698)
0812 11:06:35.039101 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.039116 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:35.039190 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:35.039910 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:35.039913 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:35.039933 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:35.040065 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:35.040071 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:35.040939 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:35.040943 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:35.041727 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:35.041737 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:35.042576 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:35.042580 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:35.042670 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:35.042700 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 11:06:35.042776 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 11:06:35.042853 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"mutex_wait_us":21}
I20260812 11:06:35.043010 334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.039060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35698 (local address 127.18.174.193:34803)
0812 11:06:35.039691 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:35.039695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:35.039707 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:06:35.039752 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:35.039754 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:35.039800 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:35.039883 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:35.040216 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:35.040842 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:35.041846 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:35.042451 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:35.042575 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:35.042629 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:35.042796 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 11:06:35.042874 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":89,"threads_started":1}
I20260812 11:06:35.043402 303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.039145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:33147 (local address 127.0.0.1:45974)
0812 11:06:35.039397 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.039409 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:35.039501 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:35.039896 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:35.039899 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:35.039917 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:35.040058 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:35.040066 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:35.041147 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:35.041150 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:35.042239 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:35.042248 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:35.043066 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:35.043070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:35.043158 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:35.043186 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 11:06:35.043231 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 11:06:35.043304 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":2,"spinlock_wait_cycles":896}
I20260812 11:06:35.043882 335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.039385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45974 (local address 127.18.174.195:33147)
0812 11:06:35.039650 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:35.039655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:35.039668 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:06:35.039720 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:35.039723 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:35.039771 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:35.040209 (+ 438us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:35.040325 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:35.041024 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:35.042369 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:35.042922 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:35.043588 (+ 666us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:35.043642 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:35.043680 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 11:06:35.043756 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":83,"threads_started":1}
I20260812 11:06:35.044152 31982 tablet_service.cc:1467] Processing CreateTablet for tablet 37ccf7dab5a14ef8b84c438aeea46bb4 (DEFAULT_TABLE table=test-table [id=6c8143ff3564440fa226c1ee069fb395]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:35.044361 32470 tablet_service.cc:1467] Processing CreateTablet for tablet 37ccf7dab5a14ef8b84c438aeea46bb4 (DEFAULT_TABLE table=test-table [id=6c8143ff3564440fa226c1ee069fb395]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:35.044467 31982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37ccf7dab5a14ef8b84c438aeea46bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:35.044593 32470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37ccf7dab5a14ef8b84c438aeea46bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:35.046657 342 tablet_bootstrap.cc:492] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068: Bootstrap starting.
I20260812 11:06:35.047325 337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.039473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:44457 (local address 127.0.0.1:59470)
0812 11:06:35.039949 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.039963 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:35.040060 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:35.040319 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:35.040322 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:35.040340 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:35.040420 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:35.040425 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:35.042025 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:35.042029 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:35.043074 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:35.043087 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:35.046879 (+ 3792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:35.046883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:35.046997 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:35.047023 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:06:35.047099 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 11:06:35.047184 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":108,"threads_started":1}
I20260812 11:06:35.047700 342 tablet_bootstrap.cc:654] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:35.047773 340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.039588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59470 (local address 127.18.174.194:44457)
0812 11:06:35.039816 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:35.039828 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:35.040041 (+ 213us) server_negotiation.cc:407] Connection header received
0812 11:06:35.040170 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:35.040172 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:35.040224 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:35.040302 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:35.041140 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:35.041924 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:35.043231 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:35.046599 (+ 3368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:35.046737 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:35.046799 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:35.047546 (+ 747us) server_negotiation.cc:299] Negotiation successful
0812 11:06:35.047642 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":72,"threads_started":1}
I20260812 11:06:35.048287 32218 tablet_service.cc:1467] Processing CreateTablet for tablet 37ccf7dab5a14ef8b84c438aeea46bb4 (DEFAULT_TABLE table=test-table [id=6c8143ff3564440fa226c1ee069fb395]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:35.048379 341 tablet_bootstrap.cc:492] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda: Bootstrap starting.
I20260812 11:06:35.048566 32218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37ccf7dab5a14ef8b84c438aeea46bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:35.049026 342 tablet_bootstrap.cc:492] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068: No bootstrap required, opened a new log
I20260812 11:06:35.049149 342 ts_tablet_manager.cc:1397] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:35.049216 341 tablet_bootstrap.cc:654] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:35.049631 342 raft_consensus.cc:348] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } } peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } }
I20260812 11:06:35.049758 342 raft_consensus.cc:374] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:35.049799 342 raft_consensus.cc:729] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4721022f36a84a28b9502b8310486068, State: Initialized, Role: FOLLOWER
I20260812 11:06:35.049970 342 consensus_queue.cc:260] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } } peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } }
I20260812 11:06:35.050319 342 ts_tablet_manager.cc:1428] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:35.050424 341 tablet_bootstrap.cc:492] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda: No bootstrap required, opened a new log
I20260812 11:06:35.050527 341 ts_tablet_manager.cc:1397] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:06:35.050973 341 raft_consensus.cc:348] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } } peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } }
I20260812 11:06:35.051090 341 raft_consensus.cc:374] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:35.051132 341 raft_consensus.cc:729] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4141b201e806415bab2a50fc18a98dda, State: Initialized, Role: FOLLOWER
I20260812 11:06:35.051259 341 consensus_queue.cc:260] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } } peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } }
I20260812 11:06:35.051590 341 ts_tablet_manager.cc:1428] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:35.051671 351 tablet_bootstrap.cc:492] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c: Bootstrap starting.
I20260812 11:06:35.052623 353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.051993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.195:37013)
0812 11:06:35.052467 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.052530 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":123,"threads_started":1}
I20260812 11:06:35.052752 351 tablet_bootstrap.cc:654] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:35.055060 32615 heartbeater.cc:503] Master 127.18.174.252:46007 was elected leader, sending a full tablet report...
I20260812 11:06:35.055088 32092 heartbeater.cc:503] Master 127.18.174.252:46007 was elected leader, sending a full tablet report...
I20260812 11:06:35.055647 353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.055273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.195:58895)
0812 11:06:35.055516 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.055576 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160}
I20260812 11:06:35.055739 351 tablet_bootstrap.cc:492] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c: No bootstrap required, opened a new log
I20260812 11:06:35.055830 351 ts_tablet_manager.cc:1397] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 11:06:35.056442 351 raft_consensus.cc:348] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } } peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } }
I20260812 11:06:35.056571 351 raft_consensus.cc:374] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:35.056610 351 raft_consensus.cc:729] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e884e163254639b724b04debf66e1c, State: Initialized, Role: FOLLOWER
I20260812 11:06:35.056764 351 consensus_queue.cc:260] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } } peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } }
I20260812 11:06:35.057209 350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.050767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.193:34005)
0812 11:06:35.057049 (+ 6282us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.057114 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6208,"thread_start_us":110,"threads_started":1}
I20260812 11:06:35.058177 351 ts_tablet_manager.cc:1428] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:06:35.058507 360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.058092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.194:38065)
0812 11:06:35.058324 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.058382 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":106,"threads_started":1}
I20260812 11:06:35.059090 360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.058873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.194:39285)
0812 11:06:35.058962 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.059025 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 11:06:35.059110 350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.057857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.193:35271)
0812 11:06:35.058275 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.058332 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342}
I20260812 11:06:35.059541 32328 heartbeater.cc:503] Master 127.18.174.252:46007 was elected leader, sending a full tablet report...
I20260812 11:06:35.307106 349 raft_consensus.cc:482] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:35.307263 349 raft_consensus.cc:504] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } } peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } }
I20260812 11:06:35.307749 349 leader_election.cc:288] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4141b201e806415bab2a50fc18a98dda (127.18.174.195:33147), 08e884e163254639b724b04debf66e1c (127.18.174.194:44457)
I20260812 11:06:35.308314 32521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccf7dab5a14ef8b84c438aeea46bb4" candidate_uuid: "4721022f36a84a28b9502b8310486068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4141b201e806415bab2a50fc18a98dda" is_pre_election: true
I20260812 11:06:35.308358 32255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccf7dab5a14ef8b84c438aeea46bb4" candidate_uuid: "4721022f36a84a28b9502b8310486068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e884e163254639b724b04debf66e1c" is_pre_election: true
I20260812 11:06:35.308506 32255 raft_consensus.cc:2454] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4721022f36a84a28b9502b8310486068 in term 0.
I20260812 11:06:35.308511 32521 raft_consensus.cc:2454] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4721022f36a84a28b9502b8310486068 in term 0.
I20260812 11:06:35.308873 31909 leader_election.cc:302] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e884e163254639b724b04debf66e1c, 4721022f36a84a28b9502b8310486068; no voters:
I20260812 11:06:35.309063 349 raft_consensus.cc:2781] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:35.309126 349 raft_consensus.cc:482] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:35.309155 349 raft_consensus.cc:3037] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:35.310238 349 raft_consensus.cc:504] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } } peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } }
I20260812 11:06:35.310599 349 leader_election.cc:288] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [CANDIDATE]: Term 1 election: Requested vote from peers 4141b201e806415bab2a50fc18a98dda (127.18.174.195:33147), 08e884e163254639b724b04debf66e1c (127.18.174.194:44457)
I20260812 11:06:35.310962 32255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccf7dab5a14ef8b84c438aeea46bb4" candidate_uuid: "4721022f36a84a28b9502b8310486068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e884e163254639b724b04debf66e1c"
I20260812 11:06:35.310962 32521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccf7dab5a14ef8b84c438aeea46bb4" candidate_uuid: "4721022f36a84a28b9502b8310486068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4141b201e806415bab2a50fc18a98dda"
I20260812 11:06:35.311093 32521 raft_consensus.cc:3037] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:35.311093 32255 raft_consensus.cc:3037] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:35.312279 32255 raft_consensus.cc:2454] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4721022f36a84a28b9502b8310486068 in term 1.
I20260812 11:06:35.312280 32521 raft_consensus.cc:2454] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4721022f36a84a28b9502b8310486068 in term 1.
I20260812 11:06:35.312589 31909 leader_election.cc:302] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e884e163254639b724b04debf66e1c, 4721022f36a84a28b9502b8310486068; no voters:
I20260812 11:06:35.312765 349 raft_consensus.cc:2781] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:35.312983 349 raft_consensus.cc:686] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [term 1 LEADER]: Becoming Leader. State: Replica: 4721022f36a84a28b9502b8310486068, State: Running, Role: LEADER
I20260812 11:06:35.313135 349 consensus_queue.cc:237] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } } peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } }
I20260812 11:06:35.313858 350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.313623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.193:48745)
0812 11:06:35.313725 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.313782 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 11:06:35.314932 31783 catalog_manager.cc:5495] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4721022f36a84a28b9502b8310486068 (127.18.174.193). New cstate: current_term: 1 leader_uuid: "4721022f36a84a28b9502b8310486068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4721022f36a84a28b9502b8310486068" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 } health_report { overall_health: UNKNOWN } } }
I20260812 11:06:35.339130 334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.336272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35714 (local address 127.18.174.193:34803)
0812 11:06:35.336392 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:35.336396 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:35.336409 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:06:35.336524 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:35.336526 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:35.336574 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:35.336635 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:35.336846 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:35.337463 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:35.338298 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:35.338515 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:35.338592 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:35.338785 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:35.338855 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:35.338900 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:35.338963 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 11:06:35.339018 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:06:35.341440 32255 raft_consensus.cc:1261] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c [term 1 FOLLOWER]: Refusing update from remote peer 4721022f36a84a28b9502b8310486068: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:35.341452 32521 raft_consensus.cc:1261] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda [term 1 FOLLOWER]: Refusing update from remote peer 4721022f36a84a28b9502b8310486068: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:35.341923 349 consensus_queue.cc:1035] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e884e163254639b724b04debf66e1c" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 44457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:35.342095 363 consensus_queue.cc:1035] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4141b201e806415bab2a50fc18a98dda" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:35.343816 360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.343353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.194:56815)
0812 11:06:35.343670 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.343736 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246}
I20260812 11:06:35.345774 353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.345442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.195:58917)
0812 11:06:35.345628 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.345687 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260812 11:06:35.346740 360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.346468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.194:38701)
0812 11:06:35.346614 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.346667 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260812 11:06:35.347149 350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.346714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.193:57421)
0812 11:06:35.347019 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.347074 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236}
I20260812 11:06:35.350332 350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.350110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.193:36355)
0812 11:06:35.350197 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.350253 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 11:06:35.352634 353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.352366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36209 (local address 127.18.174.195:46369)
0812 11:06:35.352477 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.352552 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:36209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 11:06:35.354534 31781 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:35.354700 31781 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:35.358433 31781 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bcae5fbb46344be18522cd8f928c4d8d: Sending DeleteTablet for 3 replicas of tablet 37ccf7dab5a14ef8b84c438aeea46bb4
I20260812 11:06:35.359215 31982 tablet_service.cc:1514] Processing DeleteTablet for tablet 37ccf7dab5a14ef8b84c438aeea46bb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:35 UTC) from {username='oryx', principal='oryx/127.18.174.252@KRBTEST.COM'} at 127.0.0.1:35698
I20260812 11:06:35.359341 32218 tablet_service.cc:1514] Processing DeleteTablet for tablet 37ccf7dab5a14ef8b84c438aeea46bb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:35 UTC) from {username='oryx', principal='oryx/127.18.174.252@KRBTEST.COM'} at 127.0.0.1:59470
I20260812 11:06:35.359349 32470 tablet_service.cc:1514] Processing DeleteTablet for tablet 37ccf7dab5a14ef8b84c438aeea46bb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:35 UTC) from {username='oryx', principal='oryx/127.18.174.252@KRBTEST.COM'} at 127.0.0.1:45974
I20260812 11:06:35.359642 400 tablet_replica.cc:330] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068: stopping tablet replica
I20260812 11:06:35.359712 409 tablet_replica.cc:330] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda: stopping tablet replica
I20260812 11:06:35.359772 400 raft_consensus.cc:2229] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:06:35.359817 409 raft_consensus.cc:2229] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:35.359934 409 raft_consensus.cc:2258] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:35.359993 400 raft_consensus.cc:2258] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4721022f36a84a28b9502b8310486068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:35.360065 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 31722
I20260812 11:06:35.360247 408 tablet_replica.cc:330] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c: stopping tablet replica
I20260812 11:06:35.360357 408 raft_consensus.cc:2229] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:35.360461 408 raft_consensus.cc:2258] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:35.361184 408 ts_tablet_manager.cc:1905] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:35.363579 408 ts_tablet_manager.cc:1918] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:35.363663 408 log.cc:1196] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/37ccf7dab5a14ef8b84c438aeea46bb4
I20260812 11:06:35.363898 408 ts_tablet_manager.cc:1939] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 08e884e163254639b724b04debf66e1c: Deleting consensus metadata
I20260812 11:06:35.364337 409 ts_tablet_manager.cc:1905] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:35.364763 31753 catalog_manager.cc:4841] TS 08e884e163254639b724b04debf66e1c (127.18.174.194:44457): tablet 37ccf7dab5a14ef8b84c438aeea46bb4 (table test-table [id=6c8143ff3564440fa226c1ee069fb395]) successfully deleted
I20260812 11:06:35.366546 409 ts_tablet_manager.cc:1918] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:35.366608 409 log.cc:1196] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/37ccf7dab5a14ef8b84c438aeea46bb4
I20260812 11:06:35.366791 409 ts_tablet_manager.cc:1939] T 37ccf7dab5a14ef8b84c438aeea46bb4 P 4141b201e806415bab2a50fc18a98dda: Deleting consensus metadata
I20260812 11:06:35.367507 31752 catalog_manager.cc:4841] TS 4141b201e806415bab2a50fc18a98dda (127.18.174.195:33147): tablet 37ccf7dab5a14ef8b84c438aeea46bb4 (table test-table [id=6c8143ff3564440fa226c1ee069fb395]) successfully deleted
I20260812 11:06:35.378932 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 32109
I20260812 11:06:35.379160 337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:35.378783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:34803 (local address 127.0.0.1:35730)
0812 11:06:35.378990 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:35.379064 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:34803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260812 11:06:35.393182 31753 catalog_manager.cc:4584] TS 4721022f36a84a28b9502b8310486068 (127.18.174.193:34803): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 37ccf7dab5a14ef8b84c438aeea46bb4: Network error: Client connection negotiation failed: client connection to 127.18.174.193:34803: connect: Connection refused (error 111)
I20260812 11:06:35.399473 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 32342
I20260812 11:06:35.418927 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 31182
I20260812 11:06:35.438269 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 31374
2026-08-12T11:06:35Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5935 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:06:35 dist-test-slave-lgr5 krb5kdc[414](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:06:35 dist-test-slave-lgr5 krb5kdc[414](info): set up 2 sockets
Aug 12 11:06:35 dist-test-slave-lgr5 krb5kdc[414](info): commencing operation
krb5kdc: starting...
W20260812 11:06:36.653715 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:06:36 dist-test-slave-lgr5 krb5kdc[414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:06:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:36Z Disabled control of system clock
WARNING: no policy specified for oryx/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.254.keytab.
Entry for principal oryx/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.254.keytab.
I20260812 11:06:36.779874 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:44049
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.254.keytab
--principal=oryx/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:44049
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:36.894472 437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:36.894768 437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:36.894825 437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:36.898870 437 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:36.898938 437 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 11:06:36.898960 437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:36.898984 437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:36.899006 437 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:36.899027 437 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:36.904557 437 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:44049
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.254.keytab
--principal=oryx/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:44049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:36.905740 437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:36.906908 437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:36.916162 450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:36.916172 447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:36.916172 446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:36.916450 437 server_base.cc:1034] running on GCE node
I20260812 11:06:36.917174 437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:36.918346 437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:36.919502 437 hybrid_clock.cc:648] HybridClock initialized: now 1786532796919469 us; error 47 us; skew 500 ppm
Aug 12 11:06:36 dist-test-slave-lgr5 krb5kdc[414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532796, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:36.922437 437 init.cc:377] Logged in from keytab as oryx/127.18.174.254@KRBTEST.COM (short username oryx)
I20260812 11:06:36.923470 437 webserver.cc:460] Webserver started at http://127.18.174.254:45527/ using document root <none> and password file <none>
I20260812 11:06:36.924060 437 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:36.924172 437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:36.924398 437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:36.926580 437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "65f50d34cae54584864cbbaf71d8277d"
format_stamp: "Formatted at 2026-08-12 11:06:36 on dist-test-slave-lgr5"
server_key: "5925d0aa23229968877fd966d2255716"
server_key_iv: "1c14c7680fa873f8533d4ee989fd70b7"
server_key_version: "encryptionkey@0"
I20260812 11:06:36.927186 437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "65f50d34cae54584864cbbaf71d8277d"
format_stamp: "Formatted at 2026-08-12 11:06:36 on dist-test-slave-lgr5"
server_key: "5925d0aa23229968877fd966d2255716"
server_key_iv: "1c14c7680fa873f8533d4ee989fd70b7"
server_key_version: "encryptionkey@0"
I20260812 11:06:36.931141 437 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260812 11:06:36.933759 459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:36.935098 437 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:06:36.935230 437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "65f50d34cae54584864cbbaf71d8277d"
format_stamp: "Formatted at 2026-08-12 11:06:36 on dist-test-slave-lgr5"
server_key: "5925d0aa23229968877fd966d2255716"
server_key_iv: "1c14c7680fa873f8533d4ee989fd70b7"
server_key_version: "encryptionkey@0"
I20260812 11:06:36.935340 437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:36.970911 437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:36.973958 437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:36.974172 437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:36.982271 437 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:44049
I20260812 11:06:36.982282 562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:44049 every 8 connection(s)
I20260812 11:06:36.983289 437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:36.986325 563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:36.987095 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 437
I20260812 11:06:36.987239 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:36.987583 19131 external_mini_cluster.cc:1428] Setting key 730ffa800908b342ad55f34cf80f7d3c
I20260812 11:06:36.993610 563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d: Bootstrap starting.
I20260812 11:06:36.996541 563 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d: Neither blocks nor log segments found. Creating new log.
Aug 12 11:06:36 dist-test-slave-lgr5 krb5kdc[414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
I20260812 11:06:36.997362 563 log.cc:824] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:36.999938 563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d: No bootstrap required, opened a new log
I20260812 11:06:37.003684 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:36.989142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42102 (local address 127.18.174.254:44049)
0812 11:06:36.989632 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:36.989648 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:36.989688 (+ 40us) server_negotiation.cc:407] Connection header received
0812 11:06:36.990376 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:36.990395 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:36.990792 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:36.991115 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:36.992105 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:36.993142 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:36.994266 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:36.994764 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:36.994889 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:36.997625 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:36.997632 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:36.997651 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:36.997683 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:37.000523 (+ 2840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.000950 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.000956 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.000962 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.001113 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.001336 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.001339 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.001341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.001897 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:37.002104 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:37.002292 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 11:06:37.002628 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":148,"threads_started":1}
I20260812 11:06:37.004024 563 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f50d34cae54584864cbbaf71d8277d" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44049 } }
I20260812 11:06:37.004343 563 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:37.004403 563 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65f50d34cae54584864cbbaf71d8277d, State: Initialized, Role: FOLLOWER
I20260812 11:06:37.004912 563 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f50d34cae54584864cbbaf71d8277d" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44049 } }
I20260812 11:06:37.005064 563 raft_consensus.cc:388] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:37.005131 563 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:37.005228 563 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:37.006317 563 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f50d34cae54584864cbbaf71d8277d" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44049 } }
I20260812 11:06:37.006664 563 leader_election.cc:302] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65f50d34cae54584864cbbaf71d8277d; no voters:
I20260812 11:06:37.006981 563 leader_election.cc:288] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:37.007097 569 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:37.007297 569 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [term 1 LEADER]: Becoming Leader. State: Replica: 65f50d34cae54584864cbbaf71d8277d, State: Running, Role: LEADER
I20260812 11:06:37.007655 569 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f50d34cae54584864cbbaf71d8277d" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44049 } }
I20260812 11:06:37.008252 563 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:37.009449 570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65f50d34cae54584864cbbaf71d8277d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f50d34cae54584864cbbaf71d8277d" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44049 } } }
I20260812 11:06:37.009608 570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:37.009450 572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65f50d34cae54584864cbbaf71d8277d. Latest consensus state: current_term: 1 leader_uuid: "65f50d34cae54584864cbbaf71d8277d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65f50d34cae54584864cbbaf71d8277d" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44049 } } }
I20260812 11:06:37.009902 572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:37.010068 581 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:37.013383 581 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:37.019495 581 catalog_manager.cc:1347] Generated new cluster ID: 103311a3450f426ebc0a52142984a431
I20260812 11:06:37.019578 581 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:37.027626 581 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:37.028759 581 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:37.032914 581 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d: Generated new TSK 0
I20260812 11:06:37.033774 581 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.193.keytab.
Entry for principal oryx/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.193.keytab.
I20260812 11:06:37.071174 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44049
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.193.keytab
--principal=oryx/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:37.189472 609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:37.189755 609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:37.189801 609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:37.193797 609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:37.193862 609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:37.193900 609 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:06:37.193938 609 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:37.199265 609 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.193.keytab
--principal=oryx/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.174.254:44049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:37.200388 609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:37.201408 609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:37.211187 618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:37.211194 620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:37.211529 609 server_base.cc:1034] running on GCE node
W20260812 11:06:37.211194 622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:37.211962 609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:37.212643 609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:37.213799 609 hybrid_clock.cc:648] HybridClock initialized: now 1786532797213774 us; error 37 us; skew 500 ppm
Aug 12 11:06:37 dist-test-slave-lgr5 krb5kdc[414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532797, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:37.216522 609 init.cc:377] Logged in from keytab as oryx/127.18.174.193@KRBTEST.COM (short username oryx)
I20260812 11:06:37.217397 609 webserver.cc:460] Webserver started at http://127.18.174.193:43699/ using document root <none> and password file <none>
I20260812 11:06:37.217953 609 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:37.218029 609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:37.218235 609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:37.220336 609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "f4678336aa2742c39d7b124c243841d9"
format_stamp: "Formatted at 2026-08-12 11:06:37 on dist-test-slave-lgr5"
server_key: "eb21524354d58e9da9bc4479183ee864"
server_key_iv: "c497dcf4e5f9bbd19a979792e0fa1cb9"
server_key_version: "encryptionkey@0"
I20260812 11:06:37.220892 609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "f4678336aa2742c39d7b124c243841d9"
format_stamp: "Formatted at 2026-08-12 11:06:37 on dist-test-slave-lgr5"
server_key: "eb21524354d58e9da9bc4479183ee864"
server_key_iv: "c497dcf4e5f9bbd19a979792e0fa1cb9"
server_key_version: "encryptionkey@0"
I20260812 11:06:37.224577 609 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:37.226987 630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:37.228340 609 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:37.228456 609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "f4678336aa2742c39d7b124c243841d9"
format_stamp: "Formatted at 2026-08-12 11:06:37 on dist-test-slave-lgr5"
server_key: "eb21524354d58e9da9bc4479183ee864"
server_key_iv: "c497dcf4e5f9bbd19a979792e0fa1cb9"
server_key_version: "encryptionkey@0"
I20260812 11:06:37.228555 609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:37.243456 609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:37.246717 609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:37.246908 609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:37.248474 609 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:37.248526 609 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:37.248582 609 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:37.248631 609 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:06:37 dist-test-slave-lgr5 krb5kdc[414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532797, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
I20260812 11:06:37.259035 609 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:36569
I20260812 11:06:37.259126 831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:36569 every 8 connection(s)
I20260812 11:06:37.260228 609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:06:37.262563 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.249451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:57161 (local address 127.18.174.254:44049)
0812 11:06:37.249616 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:37.249621 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:37.250569 (+ 948us) server_negotiation.cc:407] Connection header received
0812 11:06:37.251736 (+ 1167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:37.251740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:37.251806 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:37.251909 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:37.253321 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.253869 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.255088 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.255485 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.255619 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.258420 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:37.258424 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:37.258427 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:37.258459 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:37.260322 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.260930 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.260934 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.260936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.261044 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.261395 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.261399 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.261400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.261604 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:37.261698 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:37.262223 (+ 525us) server_negotiation.cc:299] Negotiation successful
0812 11:06:37.262386 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:06:37.263386 649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.249911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44049 (local address 127.18.174.193:57161)
0812 11:06:37.250383 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:37.250436 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:37.251477 (+ 1041us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:37.252142 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:37.252151 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:37.252574 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:37.253155 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.253170 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.254004 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.254008 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.254935 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.254949 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.255678 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.255684 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.255907 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.256617 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:37.256635 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:37.258185 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:37.260444 (+ 2259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:37.260449 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:37.260463 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:37.260784 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:37.261134 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:37.261138 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:37.261140 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:37.261289 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:37.261711 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:37.261718 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:37.261982 (+ 264us) client_negotiation.cc:769] Sending connection context
0812 11:06:37.262158 (+ 176us) client_negotiation.cc:240] Negotiation successful
0812 11:06:37.262514 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":107,"threads_started":1}
I20260812 11:06:37.264714 833 heartbeater.cc:347] Connected to a master server at 127.18.174.254:44049
I20260812 11:06:37.264878 833 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:37.265417 833 heartbeater.cc:511] Master 127.18.174.254:44049 requested a full tablet report, sending...
I20260812 11:06:37.267125 484 ts_manager.cc:194] Registered new tserver with Master: f4678336aa2742c39d7b124c243841d9 (127.18.174.193:36569)
I20260812 11:06:37.268622 484 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:57161
I20260812 11:06:37.268672 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 609
I20260812 11:06:37.268793 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:06:37.269119 19131 external_mini_cluster.cc:1428] Setting key c10b78697effa4b783966e533214c24e
I20260812 11:06:37.275269 844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.266921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44049 (local address 127.18.174.193:38603)
0812 11:06:37.267348 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:37.267364 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:37.267471 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:37.267694 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:37.267697 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:37.267939 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:37.268069 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.268107 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.269043 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.269047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.269845 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.269857 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.270568 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.270572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.270669 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.271229 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:37.271243 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:37.271668 (+ 425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:37.273635 (+ 1967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:37.273638 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:37.273639 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:37.273899 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:37.274240 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:37.274243 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:37.274245 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:37.274357 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:37.274784 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:37.274786 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:37.274876 (+ 90us) client_negotiation.cc:769] Sending connection context
0812 11:06:37.274953 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 11:06:37.275098 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":118,"threads_started":1}
I20260812 11:06:37.275332 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.267038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:38603 (local address 127.18.174.254:44049)
0812 11:06:37.267164 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:37.267168 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:37.267435 (+ 267us) server_negotiation.cc:407] Connection header received
0812 11:06:37.267549 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:37.267551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:37.267594 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:37.267658 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:37.268201 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.268858 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.269989 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.270319 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.270421 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.271807 (+ 1386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:37.271811 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:37.271814 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:37.271839 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:37.273506 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.274011 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.274015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.274016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.274113 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.274449 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.274452 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.274454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.274683 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:37.274777 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:37.275040 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 11:06:37.275170 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
WARNING: no policy specified for oryx/127.18.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.194.keytab.
Entry for principal oryx/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.194.keytab.
I20260812 11:06:37.298604 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44049
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.194.keytab
--principal=oryx/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:37.421036 851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:37.421340 851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:37.421406 851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:37.425568 851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:37.425649 851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:37.425705 851 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:06:37.425760 851 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:06:37.431425 851 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.194.keytab
--principal=oryx/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.174.254:44049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:37.432686 851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:37.433851 851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:37.443969 858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:37.443984 869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:37.443943 859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:37.444044 851 server_base.cc:1034] running on GCE node
I20260812 11:06:37.444658 851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:37.445356 851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:37.446527 851 hybrid_clock.cc:648] HybridClock initialized: now 1786532797446507 us; error 32 us; skew 500 ppm
Aug 12 11:06:37 dist-test-slave-lgr5 krb5kdc[414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532797, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:37.449347 851 init.cc:377] Logged in from keytab as oryx/127.18.174.194@KRBTEST.COM (short username oryx)
I20260812 11:06:37.450305 851 webserver.cc:460] Webserver started at http://127.18.174.194:45355/ using document root <none> and password file <none>
I20260812 11:06:37.450884 851 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:37.450948 851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:37.451160 851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:37.453440 851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "3c38b0e3e3c544b798246ebcf4f1a26a"
format_stamp: "Formatted at 2026-08-12 11:06:37 on dist-test-slave-lgr5"
server_key: "b0fb0576d44e7c4f337e8d79c93ea8fe"
server_key_iv: "4a3e860bd19fbb3f7c9e7f8a0899c337"
server_key_version: "encryptionkey@0"
I20260812 11:06:37.454051 851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "3c38b0e3e3c544b798246ebcf4f1a26a"
format_stamp: "Formatted at 2026-08-12 11:06:37 on dist-test-slave-lgr5"
server_key: "b0fb0576d44e7c4f337e8d79c93ea8fe"
server_key_iv: "4a3e860bd19fbb3f7c9e7f8a0899c337"
server_key_version: "encryptionkey@0"
I20260812 11:06:37.458125 851 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 11:06:37.460843 883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:37.462141 851 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:37.462268 851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "3c38b0e3e3c544b798246ebcf4f1a26a"
format_stamp: "Formatted at 2026-08-12 11:06:37 on dist-test-slave-lgr5"
server_key: "b0fb0576d44e7c4f337e8d79c93ea8fe"
server_key_iv: "4a3e860bd19fbb3f7c9e7f8a0899c337"
server_key_version: "encryptionkey@0"
I20260812 11:06:37.462380 851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:37.476970 851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:37.479986 851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:37.480216 851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:37.481837 851 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:37.481896 851 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:37.481956 851 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:37.481983 851 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:06:37 dist-test-slave-lgr5 krb5kdc[414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532797, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
I20260812 11:06:37.492726 851 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:39139
I20260812 11:06:37.493126 1106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:39139 every 8 connection(s)
I20260812 11:06:37.493748 851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:06:37.496028 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 851
I20260812 11:06:37.496047 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.482683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:38445 (local address 127.18.174.254:44049)
0812 11:06:37.482806 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:37.482810 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:37.483955 (+ 1145us) server_negotiation.cc:407] Connection header received
0812 11:06:37.485137 (+ 1182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:37.485142 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:37.485214 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:37.485310 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:37.487006 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.487825 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.489240 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.489478 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.489583 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.492269 (+ 2686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:37.492272 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:37.492274 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:37.492304 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:37.493749 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.494403 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.494405 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.494407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.494504 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.494886 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.494889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.494891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.495114 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:37.495205 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:37.495740 (+ 535us) server_negotiation.cc:299] Negotiation successful
0812 11:06:37.495878 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:06:37.496188 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:06:37.496513 19131 external_mini_cluster.cc:1428] Setting key 9ad12f5cfe6456651954a753e31482d4
I20260812 11:06:37.496977 896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.483281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44049 (local address 127.18.174.194:38445)
0812 11:06:37.483792 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:37.483837 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:37.484811 (+ 974us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:37.485552 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:37.485563 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:37.486038 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:37.486790 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.486813 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.487988 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.487992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.489101 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.489115 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.489643 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.489647 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.489838 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.490425 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:37.490450 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:37.492046 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:37.493878 (+ 1832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:37.493884 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:37.493900 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:37.494273 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:37.494594 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:37.494597 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:37.494599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:37.494792 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:37.495221 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:37.495228 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:37.495492 (+ 264us) client_negotiation.cc:769] Sending connection context
0812 11:06:37.495658 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 11:06:37.496014 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":145,"threads_started":1}
I20260812 11:06:37.498385 1109 heartbeater.cc:347] Connected to a master server at 127.18.174.254:44049
I20260812 11:06:37.498546 1109 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:37.499189 1109 heartbeater.cc:511] Master 127.18.174.254:44049 requested a full tablet report, sending...
I20260812 11:06:37.500447 482 ts_manager.cc:194] Registered new tserver with Master: 3c38b0e3e3c544b798246ebcf4f1a26a (127.18.174.194:39139)
I20260812 11:06:37.501189 482 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:38445
WARNING: no policy specified for oryx/127.18.174.195@KRBTEST.COM; defaulting to no policy
I20260812 11:06:37.509174 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.501516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:49277 (local address 127.18.174.254:44049)
0812 11:06:37.501625 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:37.501629 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:37.501643 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:06:37.501677 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:37.501680 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:37.501724 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:37.501804 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:37.502315 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.502974 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.504154 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.504372 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.504444 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.505759 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:37.505762 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:37.505764 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:37.505788 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:37.507080 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.507643 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.507647 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.507649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.507754 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.508066 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.508070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.508072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.508416 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:37.508536 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:37.508872 (+ 336us) server_negotiation.cc:299] Negotiation successful
0812 11:06:37.509005 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 11:06:37.509274 1125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.500562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44049 (local address 127.18.174.194:49277)
0812 11:06:37.500872 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:37.500888 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:37.500983 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:37.501854 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:37.501857 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:37.502075 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:37.502207 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.502215 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.503108 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.503112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.503992 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.504005 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.504488 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.504492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.504596 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.505125 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:37.505141 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:37.505619 (+ 478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:37.507200 (+ 1581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:37.507204 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:37.507206 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:37.507465 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:37.507878 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:37.507880 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:37.507882 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:37.507961 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:37.508587 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:37.508591 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:37.508692 (+ 101us) client_negotiation.cc:769] Sending connection context
0812 11:06:37.508791 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 11:06:37.508957 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":112,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.195.keytab.
Entry for principal oryx/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.195.keytab.
I20260812 11:06:37.527055 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44049
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.195.keytab
--principal=oryx/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:37.646212 1130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:37.646500 1130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:37.646548 1130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:37.651665 1130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:37.651758 1130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:37.651806 1130 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:06:37.651845 1130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:06:37.657495 1130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.195.keytab
--principal=oryx/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.174.254:44049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:37.658579 1130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:37.659659 1130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:37.670017 1142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:37.670042 1148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:37.670039 1143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:37.670354 1130 server_base.cc:1034] running on GCE node
I20260812 11:06:37.670830 1130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:37.671514 1130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:37.672683 1130 hybrid_clock.cc:648] HybridClock initialized: now 1786532797672662 us; error 34 us; skew 500 ppm
Aug 12 11:06:37 dist-test-slave-lgr5 krb5kdc[414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532797, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:37.675601 1130 init.cc:377] Logged in from keytab as oryx/127.18.174.195@KRBTEST.COM (short username oryx)
I20260812 11:06:37.676574 1130 webserver.cc:460] Webserver started at http://127.18.174.195:35749/ using document root <none> and password file <none>
I20260812 11:06:37.677142 1130 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:37.677205 1130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:37.677423 1130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:37.679517 1130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "3ffd071ebbbe46428ee80136cd396663"
format_stamp: "Formatted at 2026-08-12 11:06:37 on dist-test-slave-lgr5"
server_key: "305c272419fa0dc3ef4694ce1952dd09"
server_key_iv: "ba28460391f082c7b04e3e774410aff1"
server_key_version: "encryptionkey@0"
I20260812 11:06:37.680069 1130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "3ffd071ebbbe46428ee80136cd396663"
format_stamp: "Formatted at 2026-08-12 11:06:37 on dist-test-slave-lgr5"
server_key: "305c272419fa0dc3ef4694ce1952dd09"
server_key_iv: "ba28460391f082c7b04e3e774410aff1"
server_key_version: "encryptionkey@0"
I20260812 11:06:37.683954 1130 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 11:06:37.686571 1161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:37.687944 1130 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:37.688071 1130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "3ffd071ebbbe46428ee80136cd396663"
format_stamp: "Formatted at 2026-08-12 11:06:37 on dist-test-slave-lgr5"
server_key: "305c272419fa0dc3ef4694ce1952dd09"
server_key_iv: "ba28460391f082c7b04e3e774410aff1"
server_key_version: "encryptionkey@0"
I20260812 11:06:37.688225 1130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:37.709692 1130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:37.712842 1130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:37.713063 1130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:37.714689 1130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:37.714743 1130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:37.714787 1130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:37.714818 1130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:06:37 dist-test-slave-lgr5 krb5kdc[414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532797, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
I20260812 11:06:37.724859 1130 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:45723
I20260812 11:06:37.725097 1379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:45723 every 8 connection(s)
I20260812 11:06:37.725955 1130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:06:37.729167 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.715505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:55897 (local address 127.18.174.254:44049)
0812 11:06:37.715670 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:37.715676 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:37.716599 (+ 923us) server_negotiation.cc:407] Connection header received
0812 11:06:37.717697 (+ 1098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:37.717701 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:37.717768 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:37.717832 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:37.719628 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.720458 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.721764 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.722097 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.722199 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.725403 (+ 3204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:37.725408 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:37.725410 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:37.725444 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:37.726971 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.727627 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.727631 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.727633 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.727718 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.728047 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.728050 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.728052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.728278 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:37.728369 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:37.728874 (+ 505us) server_negotiation.cc:299] Negotiation successful
0812 11:06:37.729003 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:06:37.729987 1182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.715905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44049 (local address 127.18.174.195:55897)
0812 11:06:37.716419 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:37.716482 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:37.717433 (+ 951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:37.718299 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:37.718315 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:37.718746 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:37.719474 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.719498 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.720589 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.720592 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.721628 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.721640 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.722253 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.722257 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.722447 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.723274 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:37.723298 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:37.725187 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:37.727256 (+ 2069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:37.727261 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:37.727272 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:37.727524 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:37.727803 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:37.727806 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:37.727809 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:37.727949 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:37.728379 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:37.728386 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:37.728640 (+ 254us) client_negotiation.cc:769] Sending connection context
0812 11:06:37.728814 (+ 174us) client_negotiation.cc:240] Negotiation successful
0812 11:06:37.729164 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":143,"threads_started":1}
I20260812 11:06:37.731220 1380 heartbeater.cc:347] Connected to a master server at 127.18.174.254:44049
I20260812 11:06:37.731374 1380 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:37.731910 1380 heartbeater.cc:511] Master 127.18.174.254:44049 requested a full tablet report, sending...
I20260812 11:06:37.733124 489 ts_manager.cc:194] Registered new tserver with Master: 3ffd071ebbbe46428ee80136cd396663 (127.18.174.195:45723)
I20260812 11:06:37.733805 489 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:55897
I20260812 11:06:37.734957 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 1130
I20260812 11:06:37.735105 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:06:37.735436 19131 external_mini_cluster.cc:1428] Setting key 1a760d0e33d027e9c56cbee43378f723
I20260812 11:06:37.737496 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:06:37.740888 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.733454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:52065 (local address 127.18.174.254:44049)
0812 11:06:37.733591 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:37.733595 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:37.733807 (+ 212us) server_negotiation.cc:407] Connection header received
0812 11:06:37.733923 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:37.733926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:37.733969 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:37.734029 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:37.734500 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.735167 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.736195 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.736499 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.736597 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.737742 (+ 1145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:37.737746 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:37.737749 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:37.737775 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:37.739239 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.739651 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.739654 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.739656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.739744 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.740039 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.740042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.740044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.740281 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:37.740377 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:37.740633 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 11:06:37.740737 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:06:37.740901 1391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.733384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44049 (local address 127.18.174.195:52065)
0812 11:06:37.733729 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:37.733741 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:37.733836 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:37.734055 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:37.734058 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:37.734261 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:37.734370 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.734379 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.735297 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.735301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.736061 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.736071 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.736615 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.736619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.736697 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.737200 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:37.737213 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:37.737614 (+ 401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:37.739354 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:37.739358 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:37.739359 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:37.739566 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:37.739829 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:37.739832 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:37.739833 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:37.739950 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:37.740368 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:37.740371 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:37.740469 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 11:06:37.740566 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 11:06:37.740716 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":126,"threads_started":1}
Aug 12 11:06:37 dist-test-slave-lgr5 krb5kdc[414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532797, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:06:37 dist-test-slave-lgr5 krb5kdc[414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:37 dist-test-slave-lgr5 krb5kdc[414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:06:37.763116 566 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:37.756875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42114 (local address 127.18.174.254:44049)
0812 11:06:37.757018 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:37.757022 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:37.757035 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:06:37.757077 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:37.757080 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:37.757120 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:37.757190 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:37.757946 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.758490 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.759344 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.759563 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.759656 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.762949 (+ 3293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42114: BlockingRecv error: recv got EOF from 127.0.0.1:42114 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 11:06:37 dist-test-slave-lgr5 krb5kdc[414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532797, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
I20260812 11:06:37.773293 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.764718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42120 (local address 127.18.174.254:44049)
0812 11:06:37.764858 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:37.764863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:37.764967 (+ 104us) server_negotiation.cc:407] Connection header received
0812 11:06:37.765108 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:37.765111 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:37.765159 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:37.765227 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:37.765979 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.766586 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.767409 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.767646 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.767739 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.770189 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:37.770193 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:37.770196 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:37.770227 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:37.771498 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.771939 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.771943 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.771945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.772036 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:37.772351 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:37.772355 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:37.772357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:37.772609 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:37.772740 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:37.772996 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 11:06:37.773127 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:06:37.776479 489 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42120:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:06:37.779663 489 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:37.794728 1425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.788708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38482 (local address 127.18.174.194:39139)
0812 11:06:37.789798 (+ 1090us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:37.789811 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:37.789836 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:06:37.789916 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:37.789921 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:37.790149 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:37.790322 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:37.790638 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.791857 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.793498 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.794056 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.794187 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.794342 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:37.794465 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 11:06:37.794561 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":984,"thread_start_us":98,"threads_started":1}
I20260812 11:06:37.794714 1422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.788561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:39139 (local address 127.0.0.1:38482)
0812 11:06:37.789201 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:37.789252 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:37.789386 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:37.790317 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:37.790323 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:37.790345 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:37.790504 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.790512 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.791990 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.791994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.793392 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.793400 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.794170 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.794174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.794281 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.794319 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 11:06:37.794430 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 11:06:37.794561 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":100,"threads_started":1}
I20260812 11:06:37.794978 1426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.788670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45723 (local address 127.0.0.1:35726)
0812 11:06:37.789819 (+ 1149us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:37.789833 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:37.789934 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:37.790563 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:37.790566 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:37.790583 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:37.790701 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.790708 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.792116 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.792119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.793225 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.793236 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.794473 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.794477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.794621 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.794678 (+ 57us) client_negotiation.cc:769] Sending connection context
0812 11:06:37.794748 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 11:06:37.794820 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1093,"mutex_wait_us":54,"thread_start_us":103,"threads_started":1}
I20260812 11:06:37.795150 1427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.789414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52264 (local address 127.18.174.193:36569)
0812 11:06:37.790148 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:37.790154 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:37.790176 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:06:37.790249 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:37.790255 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:37.790423 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:37.790558 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:37.790796 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.791560 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.793379 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.794148 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.794271 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.794405 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:37.794905 (+ 500us) server_negotiation.cc:299] Negotiation successful
0812 11:06:37.795028 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":84,"threads_started":1}
I20260812 11:06:37.795400 1423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.788895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:36569 (local address 127.0.0.1:52264)
0812 11:06:37.789954 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:37.789965 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:37.790038 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:37.790551 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:37.790555 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:37.790572 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:37.790697 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.790703 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.791675 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.791679 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.793271 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.793282 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.794483 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.794487 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.794648 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.794684 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:06:37.794748 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 11:06:37.794821 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1008,"mutex_wait_us":78,"thread_start_us":89,"threads_started":1}
I20260812 11:06:37.795414 1429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.789414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35726 (local address 127.18.174.195:45723)
0812 11:06:37.789828 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:37.789844 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:37.790050 (+ 206us) server_negotiation.cc:407] Connection header received
0812 11:06:37.790133 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:37.790138 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:37.790293 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:37.790437 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:37.790824 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.791992 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.793347 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.794148 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.794283 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.794406 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:37.795177 (+ 771us) server_negotiation.cc:299] Negotiation successful
0812 11:06:37.795277 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":121,"threads_started":1}
I20260812 11:06:37.798333 1260 tablet_service.cc:1467] Processing CreateTablet for tablet f056d1f9a6374afab6b437fae17a8359 (DEFAULT_TABLE table=test-table [id=e6c70bed06cb49b3a95cb9d93e85bb24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:37.798355 718 tablet_service.cc:1467] Processing CreateTablet for tablet f056d1f9a6374afab6b437fae17a8359 (DEFAULT_TABLE table=test-table [id=e6c70bed06cb49b3a95cb9d93e85bb24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:37.798367 969 tablet_service.cc:1467] Processing CreateTablet for tablet f056d1f9a6374afab6b437fae17a8359 (DEFAULT_TABLE table=test-table [id=e6c70bed06cb49b3a95cb9d93e85bb24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:37.799418 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f056d1f9a6374afab6b437fae17a8359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:37.799418 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f056d1f9a6374afab6b437fae17a8359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:37.799437 1260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f056d1f9a6374afab6b437fae17a8359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:37.806466 1433 tablet_bootstrap.cc:492] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663: Bootstrap starting.
I20260812 11:06:37.807659 1435 tablet_bootstrap.cc:492] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9: Bootstrap starting.
I20260812 11:06:37.808517 1438 tablet_bootstrap.cc:492] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a: Bootstrap starting.
I20260812 11:06:37.809211 1433 tablet_bootstrap.cc:654] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:37.809634 1435 tablet_bootstrap.cc:654] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:37.810149 1433 log.cc:824] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:37.810437 1435 log.cc:824] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:37.810669 1438 tablet_bootstrap.cc:654] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:37.811457 1438 log.cc:824] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:37.812542 1435 tablet_bootstrap.cc:492] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9: No bootstrap required, opened a new log
I20260812 11:06:37.812747 1435 ts_tablet_manager.cc:1397] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260812 11:06:37.812796 1433 tablet_bootstrap.cc:492] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663: No bootstrap required, opened a new log
I20260812 11:06:37.812965 1433 ts_tablet_manager.cc:1397] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 11:06:37.813153 1438 tablet_bootstrap.cc:492] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a: No bootstrap required, opened a new log
I20260812 11:06:37.813287 1438 ts_tablet_manager.cc:1397] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 11:06:37.816116 1438 raft_consensus.cc:348] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } }
I20260812 11:06:37.816409 1438 raft_consensus.cc:374] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:37.816486 1438 raft_consensus.cc:729] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c38b0e3e3c544b798246ebcf4f1a26a, State: Initialized, Role: FOLLOWER
I20260812 11:06:37.816941 1438 consensus_queue.cc:260] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } }
I20260812 11:06:37.816807 1433 raft_consensus.cc:348] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } }
I20260812 11:06:37.817068 1433 raft_consensus.cc:374] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:37.817162 1433 raft_consensus.cc:729] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ffd071ebbbe46428ee80136cd396663, State: Initialized, Role: FOLLOWER
I20260812 11:06:37.817312 1435 raft_consensus.cc:348] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } }
I20260812 11:06:37.817619 1435 raft_consensus.cc:374] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:37.817641 1109 heartbeater.cc:503] Master 127.18.174.254:44049 was elected leader, sending a full tablet report...
I20260812 11:06:37.817729 1435 raft_consensus.cc:729] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4678336aa2742c39d7b124c243841d9, State: Initialized, Role: FOLLOWER
I20260812 11:06:37.817993 1438 ts_tablet_manager.cc:1428] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 11:06:37.818284 1435 consensus_queue.cc:260] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } }
I20260812 11:06:37.818621 1433 consensus_queue.cc:260] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } }
I20260812 11:06:37.818991 833 heartbeater.cc:503] Master 127.18.174.254:44049 was elected leader, sending a full tablet report...
I20260812 11:06:37.819339 1435 ts_tablet_manager.cc:1428] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260812 11:06:37.819623 1433 ts_tablet_manager.cc:1428] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260812 11:06:37.819975 1380 heartbeater.cc:503] Master 127.18.174.254:44049 was elected leader, sending a full tablet report...
I20260812 11:06:37.853250 1446 raft_consensus.cc:482] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:37.853474 1446 raft_consensus.cc:504] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } }
I20260812 11:06:37.854663 1446 leader_election.cc:288] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ffd071ebbbe46428ee80136cd396663 (127.18.174.195:45723), f4678336aa2742c39d7b124c243841d9 (127.18.174.193:36569)
I20260812 11:06:37.858963 896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.854913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45723 (local address 127.18.174.194:46021)
0812 11:06:37.855056 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:37.855071 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:37.855170 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:37.855431 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:37.855435 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:37.855456 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:37.855602 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.855609 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.856633 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.856636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.857875 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.857888 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.858597 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.858600 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.858685 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.858708 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:06:37.858767 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 11:06:37.858839 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"spinlock_wait_cycles":23168}
I20260812 11:06:37.859021 1429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.855070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:46021 (local address 127.18.174.195:45723)
0812 11:06:37.855196 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:37.855201 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:37.855216 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:06:37.855272 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:37.855275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:37.855323 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:37.855390 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:37.855710 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.856528 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.858007 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.858476 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.858603 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.858661 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:37.858796 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 11:06:37.858877 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:06:37.859511 1450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.854916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:36569 (local address 127.18.174.194:37079)
0812 11:06:37.855397 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:37.855410 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:37.855515 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:37.855732 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:37.855734 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:37.855749 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:37.855841 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.855844 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.856756 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.856758 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.858220 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:37.858228 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.859030 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.859033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:37.859128 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.859155 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 11:06:37.859265 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 11:06:37.859362 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":41,"spinlock_wait_cycles":768,"thread_start_us":148,"threads_started":1}
I20260812 11:06:37.859525 1427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.855184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:37079 (local address 127.18.174.193:36569)
0812 11:06:37.855297 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:37.855301 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:37.855507 (+ 206us) server_negotiation.cc:407] Connection header received
0812 11:06:37.855600 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:37.855602 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:37.855643 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:37.855716 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:37.855938 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.856669 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.858328 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.858902 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.859015 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.859063 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:37.859314 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 11:06:37.859399 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:06:37.859695 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f056d1f9a6374afab6b437fae17a8359" candidate_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ffd071ebbbe46428ee80136cd396663" is_pre_election: true
I20260812 11:06:37.860110 1301 raft_consensus.cc:2454] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c38b0e3e3c544b798246ebcf4f1a26a in term 0.
I20260812 11:06:37.860149 755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f056d1f9a6374afab6b437fae17a8359" candidate_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4678336aa2742c39d7b124c243841d9" is_pre_election: true
I20260812 11:06:37.860435 755 raft_consensus.cc:2454] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c38b0e3e3c544b798246ebcf4f1a26a in term 0.
I20260812 11:06:37.860635 886 leader_election.cc:302] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c38b0e3e3c544b798246ebcf4f1a26a, 3ffd071ebbbe46428ee80136cd396663; no voters:
I20260812 11:06:37.860942 1446 raft_consensus.cc:2781] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:37.861047 1446 raft_consensus.cc:482] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:37.861096 1446 raft_consensus.cc:3037] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:37.862156 1446 raft_consensus.cc:504] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } }
I20260812 11:06:37.862493 1446 leader_election.cc:288] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [CANDIDATE]: Term 1 election: Requested vote from peers 3ffd071ebbbe46428ee80136cd396663 (127.18.174.195:45723), f4678336aa2742c39d7b124c243841d9 (127.18.174.193:36569)
I20260812 11:06:37.862859 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f056d1f9a6374afab6b437fae17a8359" candidate_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ffd071ebbbe46428ee80136cd396663"
I20260812 11:06:37.862887 755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f056d1f9a6374afab6b437fae17a8359" candidate_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4678336aa2742c39d7b124c243841d9"
I20260812 11:06:37.862967 1301 raft_consensus.cc:3037] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:37.863006 755 raft_consensus.cc:3037] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:37.864058 1301 raft_consensus.cc:2454] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c38b0e3e3c544b798246ebcf4f1a26a in term 1.
I20260812 11:06:37.864109 755 raft_consensus.cc:2454] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c38b0e3e3c544b798246ebcf4f1a26a in term 1.
I20260812 11:06:37.864396 886 leader_election.cc:302] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c38b0e3e3c544b798246ebcf4f1a26a, 3ffd071ebbbe46428ee80136cd396663; no voters:
I20260812 11:06:37.864571 1446 raft_consensus.cc:2781] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:37.864827 1446 raft_consensus.cc:686] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 LEADER]: Becoming Leader. State: Replica: 3c38b0e3e3c544b798246ebcf4f1a26a, State: Running, Role: LEADER
I20260812 11:06:37.865226 1446 consensus_queue.cc:237] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } }
I20260812 11:06:37.868906 482 catalog_manager.cc:5495] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c38b0e3e3c544b798246ebcf4f1a26a (127.18.174.194). New cstate: current_term: 1 leader_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } health_report { overall_health: UNKNOWN } } }
I20260812 11:06:37.893514 1425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:37.889929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38498 (local address 127.18.174.194:39139)
0812 11:06:37.890065 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:37.890069 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:37.890086 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:06:37.890187 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:37.890190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:37.890287 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:37.890387 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:37.890567 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.891078 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.891935 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:37.892212 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:37.892378 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:37.892620 (+ 242us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:37.893081 (+ 461us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:37.893188 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:37.893280 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 11:06:37.893345 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:06:37.899616 755 raft_consensus.cc:1261] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Refusing update from remote peer 3c38b0e3e3c544b798246ebcf4f1a26a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:37.899616 1301 raft_consensus.cc:1261] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Refusing update from remote peer 3c38b0e3e3c544b798246ebcf4f1a26a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:37.900344 1446 consensus_queue.cc:1035] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:37.900552 1451 consensus_queue.cc:1035] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:37.910064 1456 mvcc.cc:205] Tried to move back new op lower bound from 7317638340189016064 to 7317638340059357184. Current Snapshot: MvccSnapshot[applied={T|T < 7317638340189016064}]
I20260812 11:06:37.910900 1457 mvcc.cc:205] Tried to move back new op lower bound from 7317638340189016064 to 7317638340059357184. Current Snapshot: MvccSnapshot[applied={T|T < 7317638340189016064}]
I20260812 11:06:37.919039 489 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42120:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:37.919224 489 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42120:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:37.921881 489 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d: Sending DeleteTablet for 3 replicas of tablet f056d1f9a6374afab6b437fae17a8359
I20260812 11:06:37.922773 969 tablet_service.cc:1514] Processing DeleteTablet for tablet f056d1f9a6374afab6b437fae17a8359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:37 UTC) from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:38482
I20260812 11:06:37.922878 718 tablet_service.cc:1514] Processing DeleteTablet for tablet f056d1f9a6374afab6b437fae17a8359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:37 UTC) from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:52264
I20260812 11:06:37.922850 1260 tablet_service.cc:1514] Processing DeleteTablet for tablet f056d1f9a6374afab6b437fae17a8359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:37 UTC) from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:35726
I20260812 11:06:37.923413 1475 tablet_replica.cc:330] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663: stopping tablet replica
I20260812 11:06:37.923465 1469 tablet_replica.cc:330] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9: stopping tablet replica
I20260812 11:06:37.923718 1470 tablet_replica.cc:330] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a: stopping tablet replica
I20260812 11:06:37.923801 489 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42120:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 11:06:37.924070 1470 raft_consensus.cc:2229] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 LEADER]: Raft consensus shutting down.
W20260812 11:06:37.924295 489 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:37.924590 1470 raft_consensus.cc:2258] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:37.925156 1469 raft_consensus.cc:2229] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:37.925194 1475 raft_consensus.cc:2229] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:37.925544 1469 raft_consensus.cc:2258] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:37.925544 1475 raft_consensus.cc:2258] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:37.927362 1475 ts_tablet_manager.cc:1905] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:37.929090 1469 ts_tablet_manager.cc:1905] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:37.930464 1475 ts_tablet_manager.cc:1918] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:37.930441 969 tablet_service.cc:1467] Processing CreateTablet for tablet 895e67792b3b4381b51be1067f7941f2 (DEFAULT_TABLE table=test-table [id=c2d3dae22cb2491bae650990bd30f18e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:37.930121 718 tablet_service.cc:1467] Processing CreateTablet for tablet 895e67792b3b4381b51be1067f7941f2 (DEFAULT_TABLE table=test-table [id=c2d3dae22cb2491bae650990bd30f18e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:37.930624 1475 log.cc:1196] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/f056d1f9a6374afab6b437fae17a8359
I20260812 11:06:37.930748 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 895e67792b3b4381b51be1067f7941f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:37.930845 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 895e67792b3b4381b51be1067f7941f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:37.930932 1475 ts_tablet_manager.cc:1939] T f056d1f9a6374afab6b437fae17a8359 P 3ffd071ebbbe46428ee80136cd396663: Deleting consensus metadata
I20260812 11:06:37.933705 464 catalog_manager.cc:4841] TS 3ffd071ebbbe46428ee80136cd396663 (127.18.174.195:45723): tablet f056d1f9a6374afab6b437fae17a8359 (table test-table [id=e6c70bed06cb49b3a95cb9d93e85bb24]) successfully deleted
I20260812 11:06:37.933954 1435 tablet_bootstrap.cc:492] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9: Bootstrap starting.
I20260812 11:06:37.934489 1260 tablet_service.cc:1467] Processing CreateTablet for tablet 895e67792b3b4381b51be1067f7941f2 (DEFAULT_TABLE table=test-table [id=c2d3dae22cb2491bae650990bd30f18e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:37.934767 1260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 895e67792b3b4381b51be1067f7941f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:37.935017 1435 tablet_bootstrap.cc:654] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:37.935607 1469 ts_tablet_manager.cc:1918] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:37.935704 1469 log.cc:1196] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/wal/wals/f056d1f9a6374afab6b437fae17a8359
I20260812 11:06:37.936023 1469 ts_tablet_manager.cc:1939] T f056d1f9a6374afab6b437fae17a8359 P f4678336aa2742c39d7b124c243841d9: Deleting consensus metadata
I20260812 11:06:37.930491 1470 ts_tablet_manager.cc:1905] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:37.937188 1435 tablet_bootstrap.cc:492] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9: No bootstrap required, opened a new log
I20260812 11:06:37.937242 1433 tablet_bootstrap.cc:492] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663: Bootstrap starting.
I20260812 11:06:37.937273 1435 ts_tablet_manager.cc:1397] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:37.938125 1435 raft_consensus.cc:348] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:37.938251 1435 raft_consensus.cc:374] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:37.938279 1435 raft_consensus.cc:729] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4678336aa2742c39d7b124c243841d9, State: Initialized, Role: FOLLOWER
I20260812 11:06:37.938303 1433 tablet_bootstrap.cc:654] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:37.938432 1435 consensus_queue.cc:260] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:37.938712 1435 ts_tablet_manager.cc:1428] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 11:06:37.939071 1470 ts_tablet_manager.cc:1918] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:37.939191 1470 log.cc:1196] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/f056d1f9a6374afab6b437fae17a8359
I20260812 11:06:37.940673 1438 tablet_bootstrap.cc:492] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a: Bootstrap starting.
I20260812 11:06:37.941023 1470 ts_tablet_manager.cc:1939] T f056d1f9a6374afab6b437fae17a8359 P 3c38b0e3e3c544b798246ebcf4f1a26a: Deleting consensus metadata
I20260812 11:06:37.941830 1438 tablet_bootstrap.cc:654] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:37.942135 465 catalog_manager.cc:4841] TS 3c38b0e3e3c544b798246ebcf4f1a26a (127.18.174.194:39139): tablet f056d1f9a6374afab6b437fae17a8359 (table test-table [id=e6c70bed06cb49b3a95cb9d93e85bb24]) successfully deleted
I20260812 11:06:37.942426 466 catalog_manager.cc:4841] TS f4678336aa2742c39d7b124c243841d9 (127.18.174.193:36569): tablet f056d1f9a6374afab6b437fae17a8359 (table test-table [id=e6c70bed06cb49b3a95cb9d93e85bb24]) successfully deleted
I20260812 11:06:37.943306 1433 tablet_bootstrap.cc:492] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663: No bootstrap required, opened a new log
I20260812 11:06:37.943409 1433 ts_tablet_manager.cc:1397] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260812 11:06:37.943431 1438 tablet_bootstrap.cc:492] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a: No bootstrap required, opened a new log
I20260812 11:06:37.943506 1438 ts_tablet_manager.cc:1397] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:37.943814 1433 raft_consensus.cc:348] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:37.943908 1433 raft_consensus.cc:374] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:37.943928 1433 raft_consensus.cc:729] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ffd071ebbbe46428ee80136cd396663, State: Initialized, Role: FOLLOWER
I20260812 11:06:37.943948 1438 raft_consensus.cc:348] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:37.944056 1438 raft_consensus.cc:374] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:37.944111 1438 raft_consensus.cc:729] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c38b0e3e3c544b798246ebcf4f1a26a, State: Initialized, Role: FOLLOWER
I20260812 11:06:37.944052 1433 consensus_queue.cc:260] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:37.944229 1438 consensus_queue.cc:260] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:37.944339 1433 ts_tablet_manager.cc:1428] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:37.944495 1438 ts_tablet_manager.cc:1428] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260812 11:06:37.977349 1382 tablet.cc:2369] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:06:37.994938 1111 tablet.cc:2369] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:06:38.011861 835 tablet.cc:2369] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:06:38.138967 1449 raft_consensus.cc:482] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:38.139183 1449 raft_consensus.cc:504] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.140470 1449 leader_election.cc:288] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4678336aa2742c39d7b124c243841d9 (127.18.174.193:36569), 3c38b0e3e3c544b798246ebcf4f1a26a (127.18.174.194:39139)
I20260812 11:06:38.142096 1447 raft_consensus.cc:482] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:38.142218 1447 raft_consensus.cc:504] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.143499 1447 leader_election.cc:288] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c38b0e3e3c544b798246ebcf4f1a26a (127.18.174.194:39139), 3ffd071ebbbe46428ee80136cd396663 (127.18.174.195:45723)
I20260812 11:06:38.144953 1425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.140864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:38941 (local address 127.18.174.194:39139)
0812 11:06:38.141024 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:38.141028 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:38.141207 (+ 179us) server_negotiation.cc:407] Connection header received
0812 11:06:38.141297 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:38.141299 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:38.141348 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:38.141410 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:38.141656 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.142381 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.143596 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.144200 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.144306 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.144367 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:38.144736 (+ 369us) server_negotiation.cc:299] Negotiation successful
0812 11:06:38.144822 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:06:38.144953 1182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.140715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:36569 (local address 127.18.174.195:35767)
0812 11:06:38.140910 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:38.140925 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:38.141032 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:38.141290 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:38.141293 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:38.141310 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:38.141434 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.141441 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.142464 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.142468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.143674 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.143688 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.144556 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.144560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.144657 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.144677 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:06:38.144738 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 11:06:38.144815 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":36}
I20260812 11:06:38.145329 1427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.140800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:35767 (local address 127.18.174.193:36569)
0812 11:06:38.140913 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:38.140928 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:38.141061 (+ 133us) server_negotiation.cc:407] Connection header received
0812 11:06:38.141128 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:38.141130 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:38.141175 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:38.141262 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:38.141547 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.142319 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.143828 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.144440 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.144562 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.144609 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:38.145123 (+ 514us) server_negotiation.cc:299] Negotiation successful
0812 11:06:38.145212 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:06:38.145596 1492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.140796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:39139 (local address 127.18.174.195:38941)
0812 11:06:38.141116 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:38.141130 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:38.141218 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:38.141437 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:38.141440 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:38.141454 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:38.141567 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.141573 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.142505 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.142508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.143426 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.143453 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.144462 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.144465 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.144577 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.144604 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 11:06:38.145359 (+ 755us) client_negotiation.cc:240] Negotiation successful
0812 11:06:38.145438 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":41,"thread_start_us":91,"threads_started":1}
I20260812 11:06:38.145936 755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895e67792b3b4381b51be1067f7941f2" candidate_uuid: "3ffd071ebbbe46428ee80136cd396663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4678336aa2742c39d7b124c243841d9" is_pre_election: true
I20260812 11:06:38.146106 755 raft_consensus.cc:2454] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ffd071ebbbe46428ee80136cd396663 in term 0.
I20260812 11:06:38.146409 1017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895e67792b3b4381b51be1067f7941f2" candidate_uuid: "3ffd071ebbbe46428ee80136cd396663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" is_pre_election: true
I20260812 11:06:38.146522 1169 leader_election.cc:302] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ffd071ebbbe46428ee80136cd396663, f4678336aa2742c39d7b124c243841d9; no voters:
I20260812 11:06:38.146664 1017 raft_consensus.cc:2454] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ffd071ebbbe46428ee80136cd396663 in term 0.
I20260812 11:06:38.146832 1449 raft_consensus.cc:2781] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:38.146884 1449 raft_consensus.cc:482] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:38.146920 1449 raft_consensus.cc:3037] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:38.148206 1449 raft_consensus.cc:504] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.148610 1449 leader_election.cc:288] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [CANDIDATE]: Term 1 election: Requested vote from peers f4678336aa2742c39d7b124c243841d9 (127.18.174.193:36569), 3c38b0e3e3c544b798246ebcf4f1a26a (127.18.174.194:39139)
I20260812 11:06:38.148636 1429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.144272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:57255 (local address 127.18.174.195:45723)
0812 11:06:38.144380 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:38.144384 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:38.144860 (+ 476us) server_negotiation.cc:407] Connection header received
0812 11:06:38.145038 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:38.145041 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:38.145083 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:38.145127 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:38.145464 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.146152 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.147697 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.148073 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.148211 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.148262 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:38.148466 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 11:06:38.148532 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:06:38.148680 1499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.143908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45723 (local address 127.18.174.193:57255)
0812 11:06:38.144783 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:38.144794 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:38.144929 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:38.145236 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:38.145239 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:38.145256 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:38.145343 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.145349 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.146272 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.146275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.147540 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.147548 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.148222 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.148226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.148346 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.148371 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:06:38.148445 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 11:06:38.148519 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":816,"mutex_wait_us":144,"thread_start_us":94,"threads_started":1}
I20260812 11:06:38.149011 1493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.143690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:39139 (local address 127.18.174.193:52133)
0812 11:06:38.144519 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:38.144533 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:38.144623 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:38.144994 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:38.144997 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:38.145012 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:06:38.145130 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.145136 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.146149 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.146153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.147504 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.147517 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.148516 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.148520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.148621 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.148646 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:06:38.148769 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 11:06:38.148844 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":760,"mutex_wait_us":3,"thread_start_us":90,"threads_started":1}
I20260812 11:06:38.149072 1017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895e67792b3b4381b51be1067f7941f2" candidate_uuid: "3ffd071ebbbe46428ee80136cd396663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a"
I20260812 11:06:38.149191 1017 raft_consensus.cc:3037] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:38.149308 1500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.144050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:52133 (local address 127.18.174.194:39139)
0812 11:06:38.144330 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:38.144334 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:38.144708 (+ 374us) server_negotiation.cc:407] Connection header received
0812 11:06:38.144761 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:38.144764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:38.144818 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:38.144888 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:06:38.145246 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.146024 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.147645 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.148276 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.148392 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.148441 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:38.149101 (+ 660us) server_negotiation.cc:299] Negotiation successful
0812 11:06:38.149196 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":109,"threads_started":1}
I20260812 11:06:38.149338 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895e67792b3b4381b51be1067f7941f2" candidate_uuid: "f4678336aa2742c39d7b124c243841d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ffd071ebbbe46428ee80136cd396663" is_pre_election: true
I20260812 11:06:38.149514 1301 raft_consensus.cc:2379] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4678336aa2742c39d7b124c243841d9 in current term 1: Already voted for candidate 3ffd071ebbbe46428ee80136cd396663 in this term.
I20260812 11:06:38.149664 1015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895e67792b3b4381b51be1067f7941f2" candidate_uuid: "f4678336aa2742c39d7b124c243841d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" is_pre_election: true
I20260812 11:06:38.149852 755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "895e67792b3b4381b51be1067f7941f2" candidate_uuid: "3ffd071ebbbe46428ee80136cd396663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4678336aa2742c39d7b124c243841d9"
I20260812 11:06:38.149960 755 raft_consensus.cc:3037] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:38.150229 634 leader_election.cc:302] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4678336aa2742c39d7b124c243841d9; no voters: 3c38b0e3e3c544b798246ebcf4f1a26a, 3ffd071ebbbe46428ee80136cd396663
I20260812 11:06:38.150460 1017 raft_consensus.cc:2454] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ffd071ebbbe46428ee80136cd396663 in term 1.
I20260812 11:06:38.150740 1165 leader_election.cc:302] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c38b0e3e3c544b798246ebcf4f1a26a, 3ffd071ebbbe46428ee80136cd396663; no voters:
I20260812 11:06:38.150909 1449 raft_consensus.cc:2781] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:38.151064 755 raft_consensus.cc:2454] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ffd071ebbbe46428ee80136cd396663 in term 1.
I20260812 11:06:38.151160 1449 raft_consensus.cc:686] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [term 1 LEADER]: Becoming Leader. State: Replica: 3ffd071ebbbe46428ee80136cd396663, State: Running, Role: LEADER
I20260812 11:06:38.151185 1447 raft_consensus.cc:2726] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 11:06:38.151418 1449 consensus_queue.cc:237] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.153772 484 catalog_manager.cc:5495] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ffd071ebbbe46428ee80136cd396663 (127.18.174.195). New cstate: current_term: 1 leader_uuid: "3ffd071ebbbe46428ee80136cd396663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } health_report { overall_health: HEALTHY } } }
Aug 12 11:06:38 dist-test-slave-lgr5 krb5kdc[414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532796, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.254@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
I20260812 11:06:38.210541 1516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.202065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44049 (local address 127.0.0.1:42126)
0812 11:06:38.202381 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:38.202397 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:38.202519 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:38.202809 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:38.202811 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:38.203254 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:38.203369 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.203376 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.204175 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.204178 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.204730 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.204737 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.205193 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.205195 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.205265 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.205833 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:38.205846 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:38.207296 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:38.209097 (+ 1801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:38.209105 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:38.209111 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:38.209345 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:38.209609 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:38.209612 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:38.209613 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:38.209703 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:38.210026 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:38.210031 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:38.210148 (+ 117us) client_negotiation.cc:769] Sending connection context
0812 11:06:38.210248 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 11:06:38.210372 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":113,"threads_started":1}
I20260812 11:06:38.210554 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.202152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42126 (local address 127.18.174.254:44049)
0812 11:06:38.202304 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:38.202308 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:38.202473 (+ 165us) server_negotiation.cc:407] Connection header received
0812 11:06:38.202644 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:38.202647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:38.202694 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:38.202779 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:38.203512 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.204051 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.204866 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.205090 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.205177 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.207458 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:38.207461 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:38.207463 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:38.207487 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:38.208992 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:38.209442 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:38.209445 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:38.209463 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:38.209539 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:38.209768 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:38.209771 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:38.209772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:38.209949 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:38.210026 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:38.210325 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 11:06:38.210429 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 11:06:38.214576 484 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:42126:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 11:06:38.215377 484 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:38.220214 718 tablet_service.cc:1467] Processing CreateTablet for tablet 1f9ce12606ab47158b1fdc5a6dec75b3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=13a2d301e29549868f781a48ee105cde]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:06:38.220243 969 tablet_service.cc:1467] Processing CreateTablet for tablet 1f9ce12606ab47158b1fdc5a6dec75b3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=13a2d301e29549868f781a48ee105cde]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:06:38.220311 1260 tablet_service.cc:1467] Processing CreateTablet for tablet 1f9ce12606ab47158b1fdc5a6dec75b3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=13a2d301e29549868f781a48ee105cde]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:06:38.220645 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f9ce12606ab47158b1fdc5a6dec75b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:38.220645 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f9ce12606ab47158b1fdc5a6dec75b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:38.220712 1260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f9ce12606ab47158b1fdc5a6dec75b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:38.223055 1433 tablet_bootstrap.cc:492] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663: Bootstrap starting.
I20260812 11:06:38.223340 1438 tablet_bootstrap.cc:492] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a: Bootstrap starting.
I20260812 11:06:38.223436 1435 tablet_bootstrap.cc:492] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9: Bootstrap starting.
I20260812 11:06:38.224017 1433 tablet_bootstrap.cc:654] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:38.224189 1438 tablet_bootstrap.cc:654] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:38.224367 1435 tablet_bootstrap.cc:654] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:38.225539 1438 tablet_bootstrap.cc:492] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a: No bootstrap required, opened a new log
I20260812 11:06:38.225584 1433 tablet_bootstrap.cc:492] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663: No bootstrap required, opened a new log
I20260812 11:06:38.225632 1438 ts_tablet_manager.cc:1397] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 11:06:38.225660 1433 ts_tablet_manager.cc:1397] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:38.225699 1435 tablet_bootstrap.cc:492] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9: No bootstrap required, opened a new log
I20260812 11:06:38.225780 1435 ts_tablet_manager.cc:1397] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:06:38.226095 1438 raft_consensus.cc:348] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.226112 1433 raft_consensus.cc:348] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.226155 1435 raft_consensus.cc:348] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.226220 1433 raft_consensus.cc:374] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:38.226223 1438 raft_consensus.cc:374] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:38.226241 1435 raft_consensus.cc:374] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:38.226257 1433 raft_consensus.cc:729] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ffd071ebbbe46428ee80136cd396663, State: Initialized, Role: FOLLOWER
I20260812 11:06:38.226264 1438 raft_consensus.cc:729] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c38b0e3e3c544b798246ebcf4f1a26a, State: Initialized, Role: FOLLOWER
I20260812 11:06:38.226270 1435 raft_consensus.cc:729] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4678336aa2742c39d7b124c243841d9, State: Initialized, Role: FOLLOWER
I20260812 11:06:38.226382 1435 consensus_queue.cc:260] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.226382 1438 consensus_queue.cc:260] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.226380 1433 consensus_queue.cc:260] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.226641 1435 ts_tablet_manager.cc:1428] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:38.226641 1438 ts_tablet_manager.cc:1428] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 11:06:38.226655 1433 ts_tablet_manager.cc:1428] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:38.226677 1449 tablet_replica.cc:439] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } }
I20260812 11:06:38.226799 1449 tablet_replica.cc:442] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:38.226821 1447 tablet_replica.cc:439] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } }
I20260812 11:06:38.226949 1447 tablet_replica.cc:442] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:38.226883 1463 tablet_replica.cc:439] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } }
I20260812 11:06:38.227010 1463 tablet_replica.cc:442] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:38.284397 1449 raft_consensus.cc:482] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:38.284569 1449 raft_consensus.cc:504] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.285032 1449 leader_election.cc:288] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4678336aa2742c39d7b124c243841d9 (127.18.174.193:36569), 3c38b0e3e3c544b798246ebcf4f1a26a (127.18.174.194:39139)
I20260812 11:06:38.285578 1017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9ce12606ab47158b1fdc5a6dec75b3" candidate_uuid: "3ffd071ebbbe46428ee80136cd396663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" is_pre_election: true
I20260812 11:06:38.285593 755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9ce12606ab47158b1fdc5a6dec75b3" candidate_uuid: "3ffd071ebbbe46428ee80136cd396663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4678336aa2742c39d7b124c243841d9" is_pre_election: true
I20260812 11:06:38.285761 1017 raft_consensus.cc:2454] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ffd071ebbbe46428ee80136cd396663 in term 0.
I20260812 11:06:38.285768 755 raft_consensus.cc:2454] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ffd071ebbbe46428ee80136cd396663 in term 0.
I20260812 11:06:38.286087 1165 leader_election.cc:302] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c38b0e3e3c544b798246ebcf4f1a26a, 3ffd071ebbbe46428ee80136cd396663; no voters:
I20260812 11:06:38.286303 1449 raft_consensus.cc:2781] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:38.286372 1449 raft_consensus.cc:482] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:38.286422 1449 raft_consensus.cc:3037] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:38.287436 1449 raft_consensus.cc:504] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.287802 1449 leader_election.cc:288] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [CANDIDATE]: Term 1 election: Requested vote from peers f4678336aa2742c39d7b124c243841d9 (127.18.174.193:36569), 3c38b0e3e3c544b798246ebcf4f1a26a (127.18.174.194:39139)
I20260812 11:06:38.288213 1017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9ce12606ab47158b1fdc5a6dec75b3" candidate_uuid: "3ffd071ebbbe46428ee80136cd396663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a"
I20260812 11:06:38.288213 755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f9ce12606ab47158b1fdc5a6dec75b3" candidate_uuid: "3ffd071ebbbe46428ee80136cd396663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4678336aa2742c39d7b124c243841d9"
I20260812 11:06:38.288355 755 raft_consensus.cc:3037] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:38.288355 1017 raft_consensus.cc:3037] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:38.289503 1017 raft_consensus.cc:2454] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ffd071ebbbe46428ee80136cd396663 in term 1.
I20260812 11:06:38.289508 755 raft_consensus.cc:2454] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ffd071ebbbe46428ee80136cd396663 in term 1.
I20260812 11:06:38.289824 1165 leader_election.cc:302] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c38b0e3e3c544b798246ebcf4f1a26a, 3ffd071ebbbe46428ee80136cd396663; no voters:
I20260812 11:06:38.289987 1449 raft_consensus.cc:2781] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:38.290074 1449 raft_consensus.cc:686] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [term 1 LEADER]: Becoming Leader. State: Replica: 3ffd071ebbbe46428ee80136cd396663, State: Running, Role: LEADER
I20260812 11:06:38.290220 1449 consensus_queue.cc:237] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.290918 1501 tablet_replica.cc:439] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663: TxnStatusTablet state changed. Reason: New leader 3ffd071ebbbe46428ee80136cd396663. Latest consensus state: current_term: 1 leader_uuid: "3ffd071ebbbe46428ee80136cd396663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } }
I20260812 11:06:38.291028 1501 tablet_replica.cc:442] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:06:38.291290 1524 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 11:06:38.291486 1524 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 11:06:38.292073 489 catalog_manager.cc:5495] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ffd071ebbbe46428ee80136cd396663 (127.18.174.195). New cstate: current_term: 1 leader_uuid: "3ffd071ebbbe46428ee80136cd396663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } health_report { overall_health: HEALTHY } } }
I20260812 11:06:38.311419 1516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.307594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45723 (local address 127.0.0.1:35742)
0812 11:06:38.307758 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:38.307775 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:38.307883 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:38.308245 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:38.308248 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:38.308256 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:06:38.308362 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.308367 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.309154 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.309157 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.309857 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.309868 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.310286 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.310290 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.310387 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.310447 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:06:38.311122 (+ 675us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:06:38.311138 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 11:06:38.311203 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 11:06:38.311294 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 11:06:38.311419 1429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.307715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35742 (local address 127.18.174.195:45723)
0812 11:06:38.307834 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:38.307838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:38.307852 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:06:38.308035 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:38.308038 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:38.308130 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:38.308217 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:38.308462 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.309025 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.309970 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.310184 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.310273 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.310593 (+ 320us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:38.311028 (+ 435us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:38.311132 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:38.311214 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 11:06:38.311270 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:06:38.314889 1017 raft_consensus.cc:1261] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Refusing update from remote peer 3ffd071ebbbe46428ee80136cd396663: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:38.314867 755 raft_consensus.cc:1261] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Refusing update from remote peer 3ffd071ebbbe46428ee80136cd396663: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:38.315462 1449 consensus_queue.cc:1035] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:38.315907 1449 consensus_queue.cc:1035] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:38.318614 1463 tablet_replica.cc:439] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a: TxnStatusTablet state changed. Reason: New leader 3ffd071ebbbe46428ee80136cd396663. Latest consensus state: current_term: 1 leader_uuid: "3ffd071ebbbe46428ee80136cd396663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } }
I20260812 11:06:38.318615 1447 tablet_replica.cc:439] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9: TxnStatusTablet state changed. Reason: New leader 3ffd071ebbbe46428ee80136cd396663. Latest consensus state: current_term: 1 leader_uuid: "3ffd071ebbbe46428ee80136cd396663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } }
I20260812 11:06:38.318737 1447 tablet_replica.cc:442] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:38.318742 1463 tablet_replica.cc:442] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:38.322014 1455 mvcc.cc:205] Tried to move back new op lower bound from 7317638341892100096 to 7317638341798322176. Current Snapshot: MvccSnapshot[applied={T|T < 7317638341892100096}]
I20260812 11:06:38.322204 1463 tablet_replica.cc:439] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3ffd071ebbbe46428ee80136cd396663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } }
I20260812 11:06:38.322213 1447 tablet_replica.cc:439] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3ffd071ebbbe46428ee80136cd396663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } }
I20260812 11:06:38.322305 1463 tablet_replica.cc:442] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3c38b0e3e3c544b798246ebcf4f1a26a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:38.322329 1447 tablet_replica.cc:442] T 1f9ce12606ab47158b1fdc5a6dec75b3 P f4678336aa2742c39d7b124c243841d9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:06:38.324433 1501 tablet_replica.cc:439] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3ffd071ebbbe46428ee80136cd396663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } }
I20260812 11:06:38.324654 1501 tablet_replica.cc:442] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:06:38.324848 1501 tablet_replica.cc:439] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3ffd071ebbbe46428ee80136cd396663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } } }
I20260812 11:06:38.324983 1501 tablet_replica.cc:442] T 1f9ce12606ab47158b1fdc5a6dec75b3 P 3ffd071ebbbe46428ee80136cd396663: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:06:38.330775 1429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.327744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35748 (local address 127.18.174.195:45723)
0812 11:06:38.327850 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:38.327854 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:38.327960 (+ 106us) server_negotiation.cc:407] Connection header received
0812 11:06:38.328124 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:38.328127 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:38.328176 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:38.328243 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:38.328503 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.328998 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.329794 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.330022 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.330110 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.330360 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:38.330434 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:38.330501 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:38.330583 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 11:06:38.330638 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 11:06:38.341632 1429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.338369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:42201 (local address 127.18.174.195:45723)
0812 11:06:38.338503 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:38.338508 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:38.338730 (+ 222us) server_negotiation.cc:407] Connection header received
0812 11:06:38.338862 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:38.338865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:38.338907 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:38.338966 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:38.339232 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.339731 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.340616 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.340821 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.340908 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.341199 (+ 291us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:38.341270 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:38.341327 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:38.341428 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 11:06:38.341473 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":42}
I20260812 11:06:38.341650 1535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.338280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45723 (local address 127.18.174.195:42201)
0812 11:06:38.338625 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:38.338638 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:38.338772 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:38.338980 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:38.338983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:38.338989 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:06:38.339136 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.339141 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.339835 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.339838 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.340503 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.340514 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.340920 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.340923 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.341027 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.341072 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:06:38.341346 (+ 274us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:06:38.341351 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 11:06:38.341408 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 11:06:38.341492 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":19,"thread_start_us":103,"threads_started":1}
I20260812 11:06:38.348628 755 raft_consensus.cc:1261] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Refusing update from remote peer 3ffd071ebbbe46428ee80136cd396663: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:38.348659 1017 raft_consensus.cc:1261] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Refusing update from remote peer 3ffd071ebbbe46428ee80136cd396663: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:38.349056 1532 consensus_queue.cc:1035] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:38.349218 1449 consensus_queue.cc:1035] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:38.391743 482 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42120:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:38.391923 482 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42120:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:38.394203 482 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d: Sending DeleteTablet for 3 replicas of tablet 895e67792b3b4381b51be1067f7941f2
I20260812 11:06:38.394841 969 tablet_service.cc:1514] Processing DeleteTablet for tablet 895e67792b3b4381b51be1067f7941f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:38 UTC) from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:38482
I20260812 11:06:38.394866 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 895e67792b3b4381b51be1067f7941f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:38 UTC) from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:52264
I20260812 11:06:38.395079 1470 tablet_replica.cc:330] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a: stopping tablet replica
I20260812 11:06:38.395107 1262 tablet_service.cc:1514] Processing DeleteTablet for tablet 895e67792b3b4381b51be1067f7941f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:38 UTC) from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:35726
I20260812 11:06:38.395234 1470 raft_consensus.cc:2229] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:38.395366 1470 raft_consensus.cc:2258] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:38.395555 1469 tablet_replica.cc:330] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9: stopping tablet replica
I20260812 11:06:38.395679 1469 raft_consensus.cc:2229] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:38.395790 1469 raft_consensus.cc:2258] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:38.395959 1475 tablet_replica.cc:330] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663: stopping tablet replica
I20260812 11:06:38.396142 1475 raft_consensus.cc:2229] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:06:38.396461 1475 raft_consensus.cc:2258] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:38.397006 1470 ts_tablet_manager.cc:1905] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:38.397284 1475 ts_tablet_manager.cc:1905] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:38.400171 1470 ts_tablet_manager.cc:1918] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:06:38.400254 1470 log.cc:1196] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/895e67792b3b4381b51be1067f7941f2
I20260812 11:06:38.400254 1475 ts_tablet_manager.cc:1918] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:06:38.400339 1475 log.cc:1196] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/895e67792b3b4381b51be1067f7941f2
I20260812 11:06:38.400506 1470 ts_tablet_manager.cc:1939] T 895e67792b3b4381b51be1067f7941f2 P 3c38b0e3e3c544b798246ebcf4f1a26a: Deleting consensus metadata
I20260812 11:06:38.400588 1475 ts_tablet_manager.cc:1939] T 895e67792b3b4381b51be1067f7941f2 P 3ffd071ebbbe46428ee80136cd396663: Deleting consensus metadata
I20260812 11:06:38.401328 464 catalog_manager.cc:4841] TS 3ffd071ebbbe46428ee80136cd396663 (127.18.174.195:45723): tablet 895e67792b3b4381b51be1067f7941f2 (table test-table [id=c2d3dae22cb2491bae650990bd30f18e]) successfully deleted
I20260812 11:06:38.401510 465 catalog_manager.cc:4841] TS 3c38b0e3e3c544b798246ebcf4f1a26a (127.18.174.194:39139): tablet 895e67792b3b4381b51be1067f7941f2 (table test-table [id=c2d3dae22cb2491bae650990bd30f18e]) successfully deleted
I20260812 11:06:38.401732 1469 ts_tablet_manager.cc:1905] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:38.403900 1469 ts_tablet_manager.cc:1918] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:06:38.403985 1469 log.cc:1196] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/wal/wals/895e67792b3b4381b51be1067f7941f2
I20260812 11:06:38.404232 1469 ts_tablet_manager.cc:1939] T 895e67792b3b4381b51be1067f7941f2 P f4678336aa2742c39d7b124c243841d9: Deleting consensus metadata
I20260812 11:06:38.405026 466 catalog_manager.cc:4841] TS f4678336aa2742c39d7b124c243841d9 (127.18.174.193:36569): tablet 895e67792b3b4381b51be1067f7941f2 (table test-table [id=c2d3dae22cb2491bae650990bd30f18e]) successfully deleted
Aug 12 11:06:38 dist-test-slave-lgr5 krb5kdc[414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:06:38 dist-test-slave-lgr5 krb5kdc[414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:38 dist-test-slave-lgr5 krb5kdc[414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:06:38.428442 566 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:38.421866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42142 (local address 127.18.174.254:44049)
0812 11:06:38.421994 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:38.421998 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:38.422240 (+ 242us) server_negotiation.cc:407] Connection header received
0812 11:06:38.422386 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:38.422390 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:38.422436 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:38.422501 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:38.423258 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.423784 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.424712 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.424933 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.425062 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.428301 (+ 3239us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42142: BlockingRecv error: recv got EOF from 127.0.0.1:42142 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 12 11:06:38 dist-test-slave-lgr5 krb5kdc[414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM
I20260812 11:06:38.439179 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.430016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42156 (local address 127.18.174.254:44049)
0812 11:06:38.430158 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:38.430162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:38.430182 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:06:38.430317 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:38.430321 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:38.430378 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:38.430485 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:38.431100 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.432020 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.432986 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.433329 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.433438 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.435947 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:38.435952 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:38.435955 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:38.435991 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:38.437508 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:38.437913 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:38.437916 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:38.437918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:38.438015 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:38.438224 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:38.438227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:38.438229 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:38.438464 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:38.438602 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:38.438849 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 11:06:38.438986 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 11:06:38.442035 482 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42156:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:06:38.442572 482 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:38.448055 718 tablet_service.cc:1467] Processing CreateTablet for tablet 449627a033244d65b4568dbb6836df43 (DEFAULT_TABLE table=test-table [id=f051d032285e471a9d6efad847c677f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:38.448208 969 tablet_service.cc:1467] Processing CreateTablet for tablet 449627a033244d65b4568dbb6836df43 (DEFAULT_TABLE table=test-table [id=f051d032285e471a9d6efad847c677f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:38.448472 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 449627a033244d65b4568dbb6836df43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:38.448520 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 449627a033244d65b4568dbb6836df43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:38.450565 1438 tablet_bootstrap.cc:492] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a: Bootstrap starting.
I20260812 11:06:38.450845 1435 tablet_bootstrap.cc:492] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9: Bootstrap starting.
I20260812 11:06:38.451385 1438 tablet_bootstrap.cc:654] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:38.451733 1435 tablet_bootstrap.cc:654] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:38.452663 1438 tablet_bootstrap.cc:492] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a: No bootstrap required, opened a new log
I20260812 11:06:38.452757 1438 ts_tablet_manager.cc:1397] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 11:06:38.452867 1262 tablet_service.cc:1467] Processing CreateTablet for tablet 449627a033244d65b4568dbb6836df43 (DEFAULT_TABLE table=test-table [id=f051d032285e471a9d6efad847c677f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:38.453213 1262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 449627a033244d65b4568dbb6836df43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:38.453210 1438 raft_consensus.cc:348] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.453341 1438 raft_consensus.cc:374] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:38.453348 1435 tablet_bootstrap.cc:492] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9: No bootstrap required, opened a new log
I20260812 11:06:38.453372 1438 raft_consensus.cc:729] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c38b0e3e3c544b798246ebcf4f1a26a, State: Initialized, Role: FOLLOWER
I20260812 11:06:38.453440 1435 ts_tablet_manager.cc:1397] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 11:06:38.453504 1438 consensus_queue.cc:260] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.453789 1438 ts_tablet_manager.cc:1428] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 11:06:38.453902 1435 raft_consensus.cc:348] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.454020 1435 raft_consensus.cc:374] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:38.454046 1435 raft_consensus.cc:729] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4678336aa2742c39d7b124c243841d9, State: Initialized, Role: FOLLOWER
I20260812 11:06:38.454151 1435 consensus_queue.cc:260] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.454370 1435 ts_tablet_manager.cc:1428] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:38.455857 1433 tablet_bootstrap.cc:492] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663: Bootstrap starting.
I20260812 11:06:38.456820 1433 tablet_bootstrap.cc:654] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:38.457929 1433 tablet_bootstrap.cc:492] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663: No bootstrap required, opened a new log
I20260812 11:06:38.458033 1433 ts_tablet_manager.cc:1397] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:06:38.458393 1433 raft_consensus.cc:348] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.458496 1433 raft_consensus.cc:374] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:38.458526 1433 raft_consensus.cc:729] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ffd071ebbbe46428ee80136cd396663, State: Initialized, Role: FOLLOWER
I20260812 11:06:38.458657 1433 consensus_queue.cc:260] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.458887 1433 ts_tablet_manager.cc:1428] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:38.464305 1447 raft_consensus.cc:482] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:38.464433 1447 raft_consensus.cc:504] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.464887 1447 leader_election.cc:288] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c38b0e3e3c544b798246ebcf4f1a26a (127.18.174.194:39139), 3ffd071ebbbe46428ee80136cd396663 (127.18.174.195:45723)
I20260812 11:06:38.465276 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449627a033244d65b4568dbb6836df43" candidate_uuid: "f4678336aa2742c39d7b124c243841d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ffd071ebbbe46428ee80136cd396663" is_pre_election: true
I20260812 11:06:38.465426 1301 raft_consensus.cc:2454] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4678336aa2742c39d7b124c243841d9 in term 0.
I20260812 11:06:38.465693 1017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449627a033244d65b4568dbb6836df43" candidate_uuid: "f4678336aa2742c39d7b124c243841d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" is_pre_election: true
I20260812 11:06:38.465760 633 leader_election.cc:302] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ffd071ebbbe46428ee80136cd396663, f4678336aa2742c39d7b124c243841d9; no voters:
I20260812 11:06:38.465852 1017 raft_consensus.cc:2454] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4678336aa2742c39d7b124c243841d9 in term 0.
I20260812 11:06:38.465941 1447 raft_consensus.cc:2781] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:38.466032 1447 raft_consensus.cc:482] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:38.466071 1447 raft_consensus.cc:3037] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:38.467150 1447 raft_consensus.cc:504] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.467491 1447 leader_election.cc:288] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [CANDIDATE]: Term 1 election: Requested vote from peers 3c38b0e3e3c544b798246ebcf4f1a26a (127.18.174.194:39139), 3ffd071ebbbe46428ee80136cd396663 (127.18.174.195:45723)
I20260812 11:06:38.467832 1017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449627a033244d65b4568dbb6836df43" candidate_uuid: "f4678336aa2742c39d7b124c243841d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a"
I20260812 11:06:38.467876 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449627a033244d65b4568dbb6836df43" candidate_uuid: "f4678336aa2742c39d7b124c243841d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ffd071ebbbe46428ee80136cd396663"
I20260812 11:06:38.467976 1301 raft_consensus.cc:3037] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:38.467962 1017 raft_consensus.cc:3037] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:38.469125 1301 raft_consensus.cc:2454] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4678336aa2742c39d7b124c243841d9 in term 1.
I20260812 11:06:38.469125 1017 raft_consensus.cc:2454] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4678336aa2742c39d7b124c243841d9 in term 1.
I20260812 11:06:38.469498 634 leader_election.cc:302] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c38b0e3e3c544b798246ebcf4f1a26a, f4678336aa2742c39d7b124c243841d9; no voters:
I20260812 11:06:38.469707 1447 raft_consensus.cc:2781] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:38.469894 1447 raft_consensus.cc:686] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [term 1 LEADER]: Becoming Leader. State: Replica: f4678336aa2742c39d7b124c243841d9, State: Running, Role: LEADER
I20260812 11:06:38.470175 1447 consensus_queue.cc:237] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.472658 482 catalog_manager.cc:5495] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4678336aa2742c39d7b124c243841d9 (127.18.174.193). New cstate: current_term: 1 leader_uuid: "f4678336aa2742c39d7b124c243841d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260812 11:06:38.489640 1427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.485922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52272 (local address 127.18.174.193:36569)
0812 11:06:38.486071 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:38.486081 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:38.486107 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:06:38.486207 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:38.486209 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:38.486273 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:38.486373 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:38.486624 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.487149 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.488046 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.488342 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.488445 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.488737 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:38.489240 (+ 503us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:38.489350 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:38.489420 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 11:06:38.489490 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:06:38.492563 1301 raft_consensus.cc:1261] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Refusing update from remote peer f4678336aa2742c39d7b124c243841d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:38.493036 1017 raft_consensus.cc:1261] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Refusing update from remote peer f4678336aa2742c39d7b124c243841d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:38.493103 1447 consensus_queue.cc:1035] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:38.493521 1577 consensus_queue.cc:1035] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:38.505511 489 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:38.505676 489 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:38.507827 489 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d: Sending DeleteTablet for 3 replicas of tablet 449627a033244d65b4568dbb6836df43
I20260812 11:06:38.508412 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 449627a033244d65b4568dbb6836df43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:38 UTC) from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:52264
I20260812 11:06:38.508630 1469 tablet_replica.cc:330] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9: stopping tablet replica
I20260812 11:06:38.508591 1262 tablet_service.cc:1514] Processing DeleteTablet for tablet 449627a033244d65b4568dbb6836df43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:38 UTC) from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:35726
I20260812 11:06:38.508764 1469 raft_consensus.cc:2229] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:06:38.509027 1469 raft_consensus.cc:2258] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:38.509227 1475 tablet_replica.cc:330] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663: stopping tablet replica
I20260812 11:06:38.509343 1475 raft_consensus.cc:2229] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:38.509457 1475 raft_consensus.cc:2258] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:38.509609 969 tablet_service.cc:1514] Processing DeleteTablet for tablet 449627a033244d65b4568dbb6836df43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:38 UTC) from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:38482
I20260812 11:06:38.509814 1470 tablet_replica.cc:330] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a: stopping tablet replica
I20260812 11:06:38.509935 1470 raft_consensus.cc:2229] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:38.510063 1470 raft_consensus.cc:2258] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:38.510937 1475 ts_tablet_manager.cc:1905] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:38.511121 489 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42156:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:06:38.511526 489 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:06:38.514110 1470 ts_tablet_manager.cc:1905] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:38.514518 1475 ts_tablet_manager.cc:1918] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:38.514667 1475 log.cc:1196] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/449627a033244d65b4568dbb6836df43
I20260812 11:06:38.515015 1475 ts_tablet_manager.cc:1939] T 449627a033244d65b4568dbb6836df43 P 3ffd071ebbbe46428ee80136cd396663: Deleting consensus metadata
I20260812 11:06:38.515961 464 catalog_manager.cc:4841] TS 3ffd071ebbbe46428ee80136cd396663 (127.18.174.195:45723): tablet 449627a033244d65b4568dbb6836df43 (table test-table [id=f051d032285e471a9d6efad847c677f9]) successfully deleted
I20260812 11:06:38.516521 1470 ts_tablet_manager.cc:1918] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:38.516601 1470 log.cc:1196] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/449627a033244d65b4568dbb6836df43
I20260812 11:06:38.516848 1470 ts_tablet_manager.cc:1939] T 449627a033244d65b4568dbb6836df43 P 3c38b0e3e3c544b798246ebcf4f1a26a: Deleting consensus metadata
I20260812 11:06:38.517944 1469 ts_tablet_manager.cc:1905] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:38.522653 1262 tablet_service.cc:1467] Processing CreateTablet for tablet 26f9ba97b5de4d2b8e5f4476b381c0b0 (DEFAULT_TABLE table=test-table [id=071b645e466047ed80745e17b5bac1b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:38.522990 1262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26f9ba97b5de4d2b8e5f4476b381c0b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:38.525554 1433 tablet_bootstrap.cc:492] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663: Bootstrap starting.
I20260812 11:06:38.526433 1433 tablet_bootstrap.cc:654] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:38.527666 969 tablet_service.cc:1467] Processing CreateTablet for tablet 26f9ba97b5de4d2b8e5f4476b381c0b0 (DEFAULT_TABLE table=test-table [id=071b645e466047ed80745e17b5bac1b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:38.527945 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26f9ba97b5de4d2b8e5f4476b381c0b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:38.530434 1438 tablet_bootstrap.cc:492] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a: Bootstrap starting.
I20260812 11:06:38.531260 1433 tablet_bootstrap.cc:492] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663: No bootstrap required, opened a new log
I20260812 11:06:38.531304 1438 tablet_bootstrap.cc:654] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:38.531352 1433 ts_tablet_manager.cc:1397] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260812 11:06:38.531800 1433 raft_consensus.cc:348] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.531924 1433 raft_consensus.cc:374] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:38.531952 1433 raft_consensus.cc:729] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ffd071ebbbe46428ee80136cd396663, State: Initialized, Role: FOLLOWER
I20260812 11:06:38.532096 1433 consensus_queue.cc:260] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.532377 1433 ts_tablet_manager.cc:1428] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:38.532925 718 tablet_service.cc:1467] Processing CreateTablet for tablet 26f9ba97b5de4d2b8e5f4476b381c0b0 (DEFAULT_TABLE table=test-table [id=071b645e466047ed80745e17b5bac1b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:06:38.533231 718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26f9ba97b5de4d2b8e5f4476b381c0b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:38.535657 1435 tablet_bootstrap.cc:492] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9: Bootstrap starting.
I20260812 11:06:38.536674 1435 tablet_bootstrap.cc:654] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:38.538648 1438 tablet_bootstrap.cc:492] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a: No bootstrap required, opened a new log
I20260812 11:06:38.538748 1438 ts_tablet_manager.cc:1397] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260812 11:06:38.539189 1438 raft_consensus.cc:348] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.539332 1438 raft_consensus.cc:374] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:38.539371 1438 raft_consensus.cc:729] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c38b0e3e3c544b798246ebcf4f1a26a, State: Initialized, Role: FOLLOWER
I20260812 11:06:38.539500 1438 consensus_queue.cc:260] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.539762 1438 ts_tablet_manager.cc:1428] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:38.540560 1435 tablet_bootstrap.cc:492] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9: No bootstrap required, opened a new log
I20260812 11:06:38.540649 1435 ts_tablet_manager.cc:1397] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 11:06:38.541113 1435 raft_consensus.cc:348] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.541220 1435 raft_consensus.cc:374] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:38.541257 1435 raft_consensus.cc:729] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4678336aa2742c39d7b124c243841d9, State: Initialized, Role: FOLLOWER
I20260812 11:06:38.541373 1435 consensus_queue.cc:260] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.541638 1435 ts_tablet_manager.cc:1428] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:06:38.545190 1469 ts_tablet_manager.cc:1918] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:06:38.545279 1469 log.cc:1196] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-0/wal/wals/449627a033244d65b4568dbb6836df43
I20260812 11:06:38.545537 1469 ts_tablet_manager.cc:1939] T 449627a033244d65b4568dbb6836df43 P f4678336aa2742c39d7b124c243841d9: Deleting consensus metadata
I20260812 11:06:38.546136 465 catalog_manager.cc:4841] TS 3c38b0e3e3c544b798246ebcf4f1a26a (127.18.174.194:39139): tablet 449627a033244d65b4568dbb6836df43 (table test-table [id=f051d032285e471a9d6efad847c677f9]) successfully deleted
I20260812 11:06:38.546445 466 catalog_manager.cc:4841] TS f4678336aa2742c39d7b124c243841d9 (127.18.174.193:36569): tablet 449627a033244d65b4568dbb6836df43 (table test-table [id=f051d032285e471a9d6efad847c677f9]) successfully deleted
I20260812 11:06:38.549033 1447 raft_consensus.cc:482] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:06:38.549145 1447 raft_consensus.cc:504] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.549568 1447 leader_election.cc:288] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c38b0e3e3c544b798246ebcf4f1a26a (127.18.174.194:39139), 3ffd071ebbbe46428ee80136cd396663 (127.18.174.195:45723)
I20260812 11:06:38.549933 1017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f9ba97b5de4d2b8e5f4476b381c0b0" candidate_uuid: "f4678336aa2742c39d7b124c243841d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" is_pre_election: true
I20260812 11:06:38.550091 1017 raft_consensus.cc:2454] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4678336aa2742c39d7b124c243841d9 in term 0.
I20260812 11:06:38.550386 634 leader_election.cc:302] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c38b0e3e3c544b798246ebcf4f1a26a, f4678336aa2742c39d7b124c243841d9; no voters:
I20260812 11:06:38.550567 1447 raft_consensus.cc:2781] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:06:38.550633 1447 raft_consensus.cc:482] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:06:38.550668 1447 raft_consensus.cc:3037] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:38.550994 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f9ba97b5de4d2b8e5f4476b381c0b0" candidate_uuid: "f4678336aa2742c39d7b124c243841d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ffd071ebbbe46428ee80136cd396663" is_pre_election: true
I20260812 11:06:38.551134 1301 raft_consensus.cc:2454] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4678336aa2742c39d7b124c243841d9 in term 0.
I20260812 11:06:38.551859 1447 raft_consensus.cc:504] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.552255 1447 leader_election.cc:288] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [CANDIDATE]: Term 1 election: Requested vote from peers 3c38b0e3e3c544b798246ebcf4f1a26a (127.18.174.194:39139), 3ffd071ebbbe46428ee80136cd396663 (127.18.174.195:45723)
I20260812 11:06:38.552577 1017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f9ba97b5de4d2b8e5f4476b381c0b0" candidate_uuid: "f4678336aa2742c39d7b124c243841d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a"
I20260812 11:06:38.552691 1017 raft_consensus.cc:3037] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:38.553856 1017 raft_consensus.cc:2454] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4678336aa2742c39d7b124c243841d9 in term 1.
I20260812 11:06:38.554134 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f9ba97b5de4d2b8e5f4476b381c0b0" candidate_uuid: "f4678336aa2742c39d7b124c243841d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ffd071ebbbe46428ee80136cd396663"
I20260812 11:06:38.554256 1301 raft_consensus.cc:3037] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:38.555464 1301 raft_consensus.cc:2454] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4678336aa2742c39d7b124c243841d9 in term 1.
I20260812 11:06:38.555872 634 leader_election.cc:302] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c38b0e3e3c544b798246ebcf4f1a26a, f4678336aa2742c39d7b124c243841d9; no voters:
I20260812 11:06:38.556205 1447 raft_consensus.cc:2781] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:38.556327 1447 raft_consensus.cc:686] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [term 1 LEADER]: Becoming Leader. State: Replica: f4678336aa2742c39d7b124c243841d9, State: Running, Role: LEADER
I20260812 11:06:38.556486 1447 consensus_queue.cc:237] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } }
I20260812 11:06:38.558635 482 catalog_manager.cc:5495] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4678336aa2742c39d7b124c243841d9 (127.18.174.193). New cstate: current_term: 1 leader_uuid: "f4678336aa2742c39d7b124c243841d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4678336aa2742c39d7b124c243841d9" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260812 11:06:38.588670 1429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.584338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:47875 (local address 127.18.174.195:45723)
0812 11:06:38.584472 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:38.584477 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:38.584724 (+ 247us) server_negotiation.cc:407] Connection header received
0812 11:06:38.584848 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:38.584852 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:38.584909 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:38.584993 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:38.585266 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.586023 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.587349 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.587724 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.587850 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.588191 (+ 341us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:38.588286 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:38.588370 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:38.588459 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 11:06:38.588519 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:06:38.588704 1600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.584236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45723 (local address 127.18.174.193:47875)
0812 11:06:38.584618 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:38.584633 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:38.584749 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:38.585009 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:38.585012 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:38.585020 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:06:38.585155 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.585161 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.586158 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.586161 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.587182 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.587195 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.587856 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.587860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.587959 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.588027 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:06:38.588378 (+ 351us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:06:38.588384 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:06:38.588445 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 11:06:38.588531 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":106,"threads_started":1}
I20260812 11:06:38.597286 1301 raft_consensus.cc:1261] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Refusing update from remote peer f4678336aa2742c39d7b124c243841d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:38.597308 1017 raft_consensus.cc:1261] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Refusing update from remote peer f4678336aa2742c39d7b124c243841d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:06:38.597699 1447 consensus_queue.cc:1035] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ffd071ebbbe46428ee80136cd396663" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:38.599190 1447 consensus_queue.cc:1035] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c38b0e3e3c544b798246ebcf4f1a26a" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:06:38.621484 1535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.614276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:36569 (local address 127.18.174.195:41283)
0812 11:06:38.614413 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:38.614430 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:38.614528 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:38.615158 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:38.615161 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:38.615169 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:06:38.615271 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.615278 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.616163 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.616167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.617067 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:38.617080 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.620679 (+ 3599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.620683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:38.620794 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.620831 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:06:38.621175 (+ 344us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:06:38.621181 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:06:38.621232 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 11:06:38.621331 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 11:06:38.621836 1427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.614817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:41283 (local address 127.18.174.193:36569)
0812 11:06:38.614922 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:38.614926 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:38.614937 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:06:38.614991 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:38.614994 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:38.615066 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:38.615143 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:06:38.615391 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.616002 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.620170 (+ 4168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:38.620549 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:38.620656 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:38.620985 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:06:38.621079 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:06:38.621137 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:38.621660 (+ 523us) server_negotiation.cc:299] Negotiation successful
0812 11:06:38.621717 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:06:38.649093 489 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:38.649288 489 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:06:38.651643 489 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 65f50d34cae54584864cbbaf71d8277d: Sending DeleteTablet for 3 replicas of tablet 26f9ba97b5de4d2b8e5f4476b381c0b0
I20260812 11:06:38.652518 718 tablet_service.cc:1514] Processing DeleteTablet for tablet 26f9ba97b5de4d2b8e5f4476b381c0b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:38 UTC) from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:52264
I20260812 11:06:38.652922 969 tablet_service.cc:1514] Processing DeleteTablet for tablet 26f9ba97b5de4d2b8e5f4476b381c0b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:38 UTC) from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:38482
I20260812 11:06:38.653167 1470 tablet_replica.cc:330] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a: stopping tablet replica
I20260812 11:06:38.653302 1470 raft_consensus.cc:2229] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:38.653438 1470 raft_consensus.cc:2258] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:38.654260 1469 tablet_replica.cc:330] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9: stopping tablet replica
I20260812 11:06:38.654395 1469 raft_consensus.cc:2229] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:06:38.654544 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 609
I20260812 11:06:38.654613 1469 raft_consensus.cc:2258] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P f4678336aa2742c39d7b124c243841d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:38.666240 1262 tablet_service.cc:1514] Processing DeleteTablet for tablet 26f9ba97b5de4d2b8e5f4476b381c0b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:06:38 UTC) from {username='oryx', principal='oryx/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:35726
I20260812 11:06:38.666501 1475 tablet_replica.cc:330] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663: stopping tablet replica
I20260812 11:06:38.666642 1475 raft_consensus.cc:2229] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:06:38.666785 1475 raft_consensus.cc:2258] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:06:38.667637 1475 ts_tablet_manager.cc:1905] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:06:38.669800 1475 ts_tablet_manager.cc:1918] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:06:38.669874 1475 log.cc:1196] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/26f9ba97b5de4d2b8e5f4476b381c0b0
I20260812 11:06:38.670084 1475 ts_tablet_manager.cc:1939] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3ffd071ebbbe46428ee80136cd396663: Deleting consensus metadata
I20260812 11:06:38.670894 464 catalog_manager.cc:4841] TS 3ffd071ebbbe46428ee80136cd396663 (127.18.174.195:45723): tablet 26f9ba97b5de4d2b8e5f4476b381c0b0 (table test-table [id=071b645e466047ed80745e17b5bac1b1]) successfully deleted
I20260812 11:06:38.672711 1470 ts_tablet_manager.cc:1905] T 26f9ba97b5de4d2b8e5f4476b381c0b0 P 3c38b0e3e3c544b798246ebcf4f1a26a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 11:06:38.673835 466 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:36569 (error 108)
I20260812 11:06:38.674038 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 851
I20260812 11:06:38.684356 1608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.681897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:36569 (local address 127.0.0.1:52276)
0812 11:06:38.684141 (+ 2244us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:38.684252 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:36569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2129,"thread_start_us":1593,"threads_started":1}
W20260812 11:06:38.684559 466 catalog_manager.cc:4584] TS f4678336aa2742c39d7b124c243841d9 (127.18.174.193:36569): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 26f9ba97b5de4d2b8e5f4476b381c0b0: Network error: Client connection negotiation failed: client connection to 127.18.174.193:36569: connect: Connection refused (error 111)
I20260812 11:06:38.693598 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 1130
I20260812 11:06:38.693738 1608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:38.693452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:39139 (local address 127.0.0.1:38512)
0812 11:06:38.693595 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:38.693647 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.194:39139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 11:06:38.724318 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 437
2026-08-12T11:06:38Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3281 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:06:38 dist-test-slave-lgr5 krb5kdc[1613](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:06:38 dist-test-slave-lgr5 krb5kdc[1613](info): set up 2 sockets
Aug 12 11:06:38 dist-test-slave-lgr5 krb5kdc[1613](info): commencing operation
krb5kdc: starting...
W20260812 11:06:39.935916 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:06:40 dist-test-slave-lgr5 krb5kdc[1613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:06:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:06:40.067840 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:33607
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:43857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:33607
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:40.183887 1641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:40.184216 1641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:40.184262 1641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:40.188337 1641 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:40.188401 1641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:40.188427 1641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:40.188446 1641 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:40.188464 1641 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:40.194041 1641 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:43857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:33607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:33607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:40.195201 1641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:40.196295 1641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:40.205062 1648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:40.205062 1654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:40.205168 1649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:40.205355 1641 server_base.cc:1034] running on GCE node
I20260812 11:06:40.205966 1641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:40.207111 1641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:40.208263 1641 hybrid_clock.cc:648] HybridClock initialized: now 1786532800208238 us; error 43 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T11:06:40Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1483 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:06:40 dist-test-slave-lgr5 krb5kdc[1668](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:06:40 dist-test-slave-lgr5 krb5kdc[1668](info): set up 2 sockets
Aug 12 11:06:40 dist-test-slave-lgr5 krb5kdc[1668](info): commencing operation
krb5kdc: starting...
W20260812 11:06:41.408372 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:06:41 dist-test-slave-lgr5 krb5kdc[1668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:06:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:06:41.539587 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45719
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:36405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:45719
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:41.655251 1692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:41.655542 1692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:41.655598 1692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:41.659615 1692 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:41.659686 1692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:41.659714 1692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:41.659735 1692 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:41.659755 1692 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:41.666049 1692 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:45719
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:41.667188 1692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:41.668286 1692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:41.676649 1710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:41.676697 1706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:41.676651 1708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:41.676903 1692 server_base.cc:1034] running on GCE node
I20260812 11:06:41.677625 1692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:41.678750 1692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:41.679908 1692 hybrid_clock.cc:648] HybridClock initialized: now 1786532801679886 us; error 35 us; skew 500 ppm
Aug 12 11:06:41 dist-test-slave-lgr5 krb5kdc[1668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532801, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:41.682648 1692 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:06:41.683619 1692 webserver.cc:460] Webserver started at http://127.18.174.254:33673/ using document root <none> and password file <none>
I20260812 11:06:41.684248 1692 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:41.684329 1692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:41.684543 1692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:41.686719 1692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "6d8adbc5997d4544aa0f6d45870ba5cb"
format_stamp: "Formatted at 2026-08-12 11:06:41 on dist-test-slave-lgr5"
server_key: "4250a92ddc01dca772e453f0b39c3488"
server_key_iv: "36c40458349c10b8fc601c7b96e99fb0"
server_key_version: "encryptionkey@0"
I20260812 11:06:41.687325 1692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "6d8adbc5997d4544aa0f6d45870ba5cb"
format_stamp: "Formatted at 2026-08-12 11:06:41 on dist-test-slave-lgr5"
server_key: "4250a92ddc01dca772e453f0b39c3488"
server_key_iv: "36c40458349c10b8fc601c7b96e99fb0"
server_key_version: "encryptionkey@0"
I20260812 11:06:41.691253 1692 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:06:41.693924 1723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:41.695267 1692 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:06:41.695420 1692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "6d8adbc5997d4544aa0f6d45870ba5cb"
format_stamp: "Formatted at 2026-08-12 11:06:41 on dist-test-slave-lgr5"
server_key: "4250a92ddc01dca772e453f0b39c3488"
server_key_iv: "36c40458349c10b8fc601c7b96e99fb0"
server_key_version: "encryptionkey@0"
I20260812 11:06:41.695544 1692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:41.708768 1692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:41.711776 1692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:41.711984 1692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:41.719139 1692 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:45719
I20260812 11:06:41.719172 1828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:45719 every 8 connection(s)
I20260812 11:06:41.720206 1692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:41.723088 1836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:41.727111 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 1692
I20260812 11:06:41.727262 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:41.727591 19131 external_mini_cluster.cc:1428] Setting key 687a8307f62bf68d58ce79da99b61ea2
I20260812 11:06:41.729712 1836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb: Bootstrap starting.
I20260812 11:06:41.732045 1836 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:41.732833 1836 log.cc:824] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:41.735069 1836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb: No bootstrap required, opened a new log
Aug 12 11:06:41 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:41.739063 1836 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45719 } }
I20260812 11:06:41.739316 1836 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:41.739389 1836 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8adbc5997d4544aa0f6d45870ba5cb, State: Initialized, Role: FOLLOWER
I20260812 11:06:41.739862 1836 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45719 } }
I20260812 11:06:41.740006 1836 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:41.740094 1836 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:41.740206 1836 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:41.741253 1836 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45719 } }
I20260812 11:06:41.741654 1836 leader_election.cc:302] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d8adbc5997d4544aa0f6d45870ba5cb; no voters:
I20260812 11:06:41.742056 1836 leader_election.cc:288] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:41.742214 1844 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:41.742434 1844 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 1 LEADER]: Becoming Leader. State: Replica: 6d8adbc5997d4544aa0f6d45870ba5cb, State: Running, Role: LEADER
I20260812 11:06:41.742832 1844 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45719 } }
I20260812 11:06:41.743278 1841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:41.729170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35188 (local address 127.18.174.254:45719)
0812 11:06:41.729643 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:41.729660 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:41.729700 (+ 40us) server_negotiation.cc:407] Connection header received
0812 11:06:41.730396 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:41.730418 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:41.730780 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:41.731098 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:41.731927 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:41.733124 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:41.734214 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:41.734700 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:41.734831 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:41.737695 (+ 2864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:41.737701 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:41.737718 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:41.737769 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:41.739995 (+ 2226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:41.740528 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:41.740533 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:41.740538 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:41.740654 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:41.740953 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:41.740956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:41.740957 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:41.741378 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:41.741568 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:41.741890 (+ 322us) server_negotiation.cc:299] Negotiation successful
0812 11:06:41.742204 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":134,"threads_started":1}
I20260812 11:06:41.743445 1836 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:41.744661 1847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45719 } } }
I20260812 11:06:41.744793 1847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:41.745016 1844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d8adbc5997d4544aa0f6d45870ba5cb. Latest consensus state: current_term: 1 leader_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45719 } } }
I20260812 11:06:41.745093 1844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:41.746222 1869 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:41.749565 1869 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:41.755568 1869 catalog_manager.cc:1347] Generated new cluster ID: 194d6b75635d40618c24b2b44803088c
I20260812 11:06:41.755656 1869 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:41.764556 1869 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:41.765849 1869 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:41.775146 1869 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb: Generated new TSK 0
I20260812 11:06:41.776118 1869 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:06:41.814424 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45719
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:36405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:41.931615 1896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:41.931910 1896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:41.931973 1896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:41.936117 1896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:41.936192 1896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:41.936276 1896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:41.941932 1896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:41.943140 1896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:41.944324 1896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:41.954605 1907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:41.954620 1912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:41.954599 1906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:41.954846 1896 server_base.cc:1034] running on GCE node
I20260812 11:06:41.955436 1896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:41.956173 1896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:41.957347 1896 hybrid_clock.cc:648] HybridClock initialized: now 1786532801957326 us; error 39 us; skew 500 ppm
Aug 12 11:06:41 dist-test-slave-lgr5 krb5kdc[1668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532801, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:41.960253 1896 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:06:41.961237 1896 webserver.cc:460] Webserver started at http://127.18.174.193:34961/ using document root <none> and password file <none>
I20260812 11:06:41.961815 1896 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:41.961882 1896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:41.962088 1896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:41.964234 1896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "d345269cd93340d084d8bf8a94504ef9"
format_stamp: "Formatted at 2026-08-12 11:06:41 on dist-test-slave-lgr5"
server_key: "964237584300b18e4c434a517cc0e51e"
server_key_iv: "60a9be6e210cd07f1bcf3b9f60dc181d"
server_key_version: "encryptionkey@0"
I20260812 11:06:41.964808 1896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "d345269cd93340d084d8bf8a94504ef9"
format_stamp: "Formatted at 2026-08-12 11:06:41 on dist-test-slave-lgr5"
server_key: "964237584300b18e4c434a517cc0e51e"
server_key_iv: "60a9be6e210cd07f1bcf3b9f60dc181d"
server_key_version: "encryptionkey@0"
I20260812 11:06:41.968621 1896 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260812 11:06:41.971149 1924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:41.972774 1896 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:41.972908 1896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "d345269cd93340d084d8bf8a94504ef9"
format_stamp: "Formatted at 2026-08-12 11:06:41 on dist-test-slave-lgr5"
server_key: "964237584300b18e4c434a517cc0e51e"
server_key_iv: "60a9be6e210cd07f1bcf3b9f60dc181d"
server_key_version: "encryptionkey@0"
I20260812 11:06:41.973028 1896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:41.997022 1896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:42.000133 1896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:42.000329 1896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:42.000982 1896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:42.001920 1896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:42.001971 1896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:42.002017 1896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:42.002038 1896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:42.010991 1896 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:43493
I20260812 11:06:42.011026 2143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:43493 every 8 connection(s)
I20260812 11:06:42.012015 1896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
Aug 12 11:06:42 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532801, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:42.022043 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 1896
I20260812 11:06:42.022166 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:06:42.022452 19131 external_mini_cluster.cc:1428] Setting key bc681d72692a9ba46669607b56eacf34
I20260812 11:06:42.026422 1841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:42.013886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:43963 (local address 127.18.174.254:45719)
0812 11:06:42.014068 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:42.014074 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:42.014930 (+ 856us) server_negotiation.cc:407] Connection header received
0812 11:06:42.016445 (+ 1515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:42.016449 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:42.016503 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:42.016579 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:42.017794 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:42.018334 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:42.019418 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:42.019634 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:42.019704 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:42.022213 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:42.022216 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:42.022219 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:42.022251 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:42.023897 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:42.024547 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:42.024550 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:42.024551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:42.024636 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:42.025028 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:42.025031 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:42.025032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:42.025223 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:42.025297 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:42.026002 (+ 705us) server_negotiation.cc:299] Negotiation successful
0812 11:06:42.026161 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:06:42.027242 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:42.014297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:43963)
0812 11:06:42.014772 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:42.014817 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:42.016205 (+ 1388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:42.016755 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:42.016762 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:42.017152 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:42.017666 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:42.017680 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:42.018428 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:42.018430 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:42.019324 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:42.019334 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:42.019747 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:42.019750 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:42.019896 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:42.020513 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:42.020530 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:42.022028 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:42.024016 (+ 1988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:42.024021 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:42.024040 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:42.024440 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:42.024729 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:42.024732 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:42.024734 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:42.024929 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:42.025313 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:42.025320 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:42.025679 (+ 359us) client_negotiation.cc:769] Sending connection context
0812 11:06:42.025899 (+ 220us) client_negotiation.cc:240] Negotiation successful
0812 11:06:42.026302 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":132,"threads_started":1}
I20260812 11:06:42.028573 2144 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45719
I20260812 11:06:42.028874 2144 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:42.029618 2144 heartbeater.cc:511] Master 127.18.174.254:45719 requested a full tablet report, sending...
I20260812 11:06:42.031378 1759 ts_manager.cc:194] Registered new tserver with Master: d345269cd93340d084d8bf8a94504ef9 (127.18.174.193:43493)
I20260812 11:06:42.032608 1759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:43963
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:06:42.051672 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45719
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:36405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:42.169683 2153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:42.169961 2153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:42.170006 2153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:42.174027 2153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:42.174095 2153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:42.174155 2153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:06:42.180018 2153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:42.181147 2153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:42.182210 2153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:06:42.192333 2153 server_base.cc:1034] running on GCE node
W20260812 11:06:42.192359 2169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:42.192281 2164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:42.192281 2163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:42.192973 2153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:42.193703 2153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:42.194857 2153 hybrid_clock.cc:648] HybridClock initialized: now 1786532802194820 us; error 53 us; skew 500 ppm
Aug 12 11:06:42 dist-test-slave-lgr5 krb5kdc[1668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532802, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:42.197638 2153 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:06:42.198585 2153 webserver.cc:460] Webserver started at http://127.18.174.194:40871/ using document root <none> and password file <none>
I20260812 11:06:42.199177 2153 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:42.199246 2153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:42.199452 2153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:42.201730 2153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "59cd527567f4425e890876499f40cb68"
format_stamp: "Formatted at 2026-08-12 11:06:42 on dist-test-slave-lgr5"
server_key: "0fdf115c4eeb715ec1e2ee90a8483c3d"
server_key_iv: "980ebb137de10b5f8ca5556632d6dcff"
server_key_version: "encryptionkey@0"
I20260812 11:06:42.202332 2153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "59cd527567f4425e890876499f40cb68"
format_stamp: "Formatted at 2026-08-12 11:06:42 on dist-test-slave-lgr5"
server_key: "0fdf115c4eeb715ec1e2ee90a8483c3d"
server_key_iv: "980ebb137de10b5f8ca5556632d6dcff"
server_key_version: "encryptionkey@0"
I20260812 11:06:42.206378 2153 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:06:42.209124 2189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:42.210434 2153 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:06:42.210561 2153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "59cd527567f4425e890876499f40cb68"
format_stamp: "Formatted at 2026-08-12 11:06:42 on dist-test-slave-lgr5"
server_key: "0fdf115c4eeb715ec1e2ee90a8483c3d"
server_key_iv: "980ebb137de10b5f8ca5556632d6dcff"
server_key_version: "encryptionkey@0"
I20260812 11:06:42.210676 2153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:42.230571 2153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:42.233807 2153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:42.234016 2153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:42.234651 2153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:42.235607 2153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:42.235658 2153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:42.235714 2153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:42.235743 2153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:42.245048 2153 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:45935
I20260812 11:06:42.245090 2403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:45935 every 8 connection(s)
I20260812 11:06:42.246054 2153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:06:42.249071 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 2153
I20260812 11:06:42.249200 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:06:42.249480 19131 external_mini_cluster.cc:1428] Setting key 25f53b7664c15b74ebc8c4ba82621617
Aug 12 11:06:42 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532802, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
I20260812 11:06:42.260169 1841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:42.247883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:42441 (local address 127.18.174.254:45719)
0812 11:06:42.248017 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:42.248021 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:42.248999 (+ 978us) server_negotiation.cc:407] Connection header received
0812 11:06:42.250423 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:42.250426 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:42.250480 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:42.250554 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:42.251774 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:42.252357 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:42.253534 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:42.253773 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:42.253864 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:42.256620 (+ 2756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:42.256623 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:42.256626 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:42.256654 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:42.257959 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:42.258487 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:42.258491 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:42.258492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:42.258571 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:42.258903 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:42.258906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:42.258908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:42.259108 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:42.259197 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:42.259775 (+ 578us) server_negotiation.cc:299] Negotiation successful
0812 11:06:42.259923 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:06:42.261147 2415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:42.248334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:42441)
0812 11:06:42.248828 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:42.248873 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:42.250215 (+ 1342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:42.250747 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:42.250755 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:42.251123 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:42.251630 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:42.251645 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:42.252495 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:42.252498 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:42.253411 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:42.253422 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:42.253923 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:42.253928 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:42.254105 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:42.254697 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:42.254715 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:42.256432 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:42.258082 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:42.258089 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:42.258108 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:42.258381 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:42.258658 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:42.258661 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:42.258663 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:42.258813 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:42.259213 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:42.259221 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:42.259520 (+ 299us) client_negotiation.cc:769] Sending connection context
0812 11:06:42.259712 (+ 192us) client_negotiation.cc:240] Negotiation successful
0812 11:06:42.260117 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":140,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
I20260812 11:06:42.262522 2411 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45719
I20260812 11:06:42.262791 2411 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:42.263348 2411 heartbeater.cc:511] Master 127.18.174.254:45719 requested a full tablet report, sending...
I20260812 11:06:42.264460 1759 ts_manager.cc:194] Registered new tserver with Master: 59cd527567f4425e890876499f40cb68 (127.18.174.194:45935)
I20260812 11:06:42.265054 1759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:42441
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:06:42.278584 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45719
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:36405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:42.401057 2419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:42.401466 2419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:42.401535 2419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:42.406898 2419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:42.406996 2419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:42.407083 2419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:06:42.415095 2419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:42.416728 2419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:42.418218 2419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:42.430795 2429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:42.430769 2433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:42.430884 2438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:42.431996 2419 server_base.cc:1034] running on GCE node
I20260812 11:06:42.432608 2419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:42.433547 2419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:42.434755 2419 hybrid_clock.cc:648] HybridClock initialized: now 1786532802434734 us; error 32 us; skew 500 ppm
Aug 12 11:06:42 dist-test-slave-lgr5 krb5kdc[1668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532802, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:42.438443 2419 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:06:42.439604 2419 webserver.cc:460] Webserver started at http://127.18.174.195:43071/ using document root <none> and password file <none>
I20260812 11:06:42.440362 2419 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:42.440450 2419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:42.440678 2419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:42.443511 2419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "3d9adfcaebb04a919b3ddd324d3ec6a2"
format_stamp: "Formatted at 2026-08-12 11:06:42 on dist-test-slave-lgr5"
server_key: "9c0c7ab21649feb2747598a009a9c9fb"
server_key_iv: "0c0c8696c8a9b391c5df6cf83ca118d7"
server_key_version: "encryptionkey@0"
I20260812 11:06:42.444216 2419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "3d9adfcaebb04a919b3ddd324d3ec6a2"
format_stamp: "Formatted at 2026-08-12 11:06:42 on dist-test-slave-lgr5"
server_key: "9c0c7ab21649feb2747598a009a9c9fb"
server_key_iv: "0c0c8696c8a9b391c5df6cf83ca118d7"
server_key_version: "encryptionkey@0"
I20260812 11:06:42.449083 2419 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260812 11:06:42.452193 2450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:42.453735 2419 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:06:42.453872 2419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "3d9adfcaebb04a919b3ddd324d3ec6a2"
format_stamp: "Formatted at 2026-08-12 11:06:42 on dist-test-slave-lgr5"
server_key: "9c0c7ab21649feb2747598a009a9c9fb"
server_key_iv: "0c0c8696c8a9b391c5df6cf83ca118d7"
server_key_version: "encryptionkey@0"
I20260812 11:06:42.454000 2419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:42.481604 2419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:42.485621 2419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:42.485852 2419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:42.486642 2419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:42.487803 2419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:42.487870 2419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:42.487936 2419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:42.487965 2419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:42.499264 2419 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:43855
I20260812 11:06:42.499285 2705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:43855 every 8 connection(s)
I20260812 11:06:42.500571 2419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:06:42.508690 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 2419
I20260812 11:06:42.508834 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:06:42.509133 19131 external_mini_cluster.cc:1428] Setting key b62650983c63d4985e5fb28a2383e3d1
Aug 12 11:06:42 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532802, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:06:42.518972 1841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:42.502682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:56535 (local address 127.18.174.254:45719)
0812 11:06:42.502828 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:42.502831 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:42.503968 (+ 1137us) server_negotiation.cc:407] Connection header received
0812 11:06:42.505400 (+ 1432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:42.505404 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:42.505469 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:42.505552 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:42.506889 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:42.507436 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:42.510554 (+ 3118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:42.510897 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:42.510973 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:42.514466 (+ 3493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:42.514470 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:42.514472 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:42.514502 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:42.516366 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:42.517094 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:42.517098 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:42.517099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:42.517189 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:42.517654 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:42.517657 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:42.517658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:42.517890 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:42.517983 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:42.518710 (+ 727us) server_negotiation.cc:299] Negotiation successful
0812 11:06:42.518841 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:06:42.520219 2713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:42.503210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:56535)
0812 11:06:42.503797 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:42.503845 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:42.505157 (+ 1312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:42.505773 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:42.505781 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:42.506187 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:42.506731 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:42.506747 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:42.507572 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:42.507575 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:42.510388 (+ 2813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:42.510403 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:42.511202 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:42.511206 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:42.511431 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:42.512188 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:42.512211 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:42.514267 (+ 2056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:42.516531 (+ 2264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:42.516539 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:42.516559 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:42.516941 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:42.517281 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:06:42.517285 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:06:42.517287 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:06:42.517499 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:06:42.517992 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:42.517999 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:42.518369 (+ 370us) client_negotiation.cc:769] Sending connection context
0812 11:06:42.518621 (+ 252us) client_negotiation.cc:240] Negotiation successful
0812 11:06:42.519029 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":174,"threads_started":1}
I20260812 11:06:42.521517 2711 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45719
I20260812 11:06:42.521750 2711 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:42.522275 2711 heartbeater.cc:511] Master 127.18.174.254:45719 requested a full tablet report, sending...
I20260812 11:06:42.523307 1759 ts_manager.cc:194] Registered new tserver with Master: 3d9adfcaebb04a919b3ddd324d3ec6a2 (127.18.174.195:43855)
I20260812 11:06:42.523882 1759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:56535
I20260812 11:06:42.525774 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.193.keytab.
Entry for principal oryx/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.193.keytab.
WARNING: no policy specified for oryx/127.18.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.194.keytab.
Entry for principal oryx/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.194.keytab.
WARNING: no policy specified for oryx/127.18.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.195.keytab.
Entry for principal oryx/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.195.keytab.
I20260812 11:06:42.603519 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 1896
I20260812 11:06:42.625976 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 2153
I20260812 11:06:42.646080 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 2419
I20260812 11:06:42.660637 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 1692
I20260812 11:06:42.677690 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45719
--webserver_interface=127.18.174.254
--webserver_port=33673
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:36405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:45719
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:06:42.793650 2723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:42.793999 2723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:42.794063 2723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:42.798228 2723 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:42.798300 2723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:42.798327 2723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:42.798357 2723 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:42.798388 2723 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:42.803897 2723 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:45719
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=33673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:42.805079 2723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:42.806157 2723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:42.814972 2733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:42.815009 2740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:42.815243 2735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:42.815374 2723 server_base.cc:1034] running on GCE node
I20260812 11:06:42.816004 2723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:42.817219 2723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:42.818397 2723 hybrid_clock.cc:648] HybridClock initialized: now 1786532802818363 us; error 44 us; skew 500 ppm
Aug 12 11:06:42 dist-test-slave-lgr5 krb5kdc[1668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532802, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:42.821197 2723 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:06:42.822175 2723 webserver.cc:460] Webserver started at http://127.18.174.254:33673/ using document root <none> and password file <none>
I20260812 11:06:42.822768 2723 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:42.822853 2723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:42.826900 2723 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:42.829097 2752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:42.830320 2723 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:06:42.830439 2723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "6d8adbc5997d4544aa0f6d45870ba5cb"
format_stamp: "Formatted at 2026-08-12 11:06:41 on dist-test-slave-lgr5"
server_key: "4250a92ddc01dca772e453f0b39c3488"
server_key_iv: "36c40458349c10b8fc601c7b96e99fb0"
server_key_version: "encryptionkey@0"
I20260812 11:06:42.831000 2723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:42.858227 2723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:42.861410 2723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:42.861636 2723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:42.869295 2723 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:45719
I20260812 11:06:42.869309 2853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:45719 every 8 connection(s)
I20260812 11:06:42.870419 2723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:42.874752 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 2723
I20260812 11:06:42.875089 2854 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:06:42.875303 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:43493
--local_ip_for_outbound_sockets=127.18.174.193
--tserver_master_addrs=127.18.174.254:45719
--webserver_port=34961
--webserver_interface=127.18.174.193
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:36405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.18.174.193
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:06:42.877344 2854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb: Bootstrap starting.
I20260812 11:06:42.894675 2854 log.cc:824] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:42.901726 2854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:06:42.902112 2854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb: Bootstrap complete.
I20260812 11:06:42.906337 2854 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45719 } }
I20260812 11:06:42.906771 2854 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8adbc5997d4544aa0f6d45870ba5cb, State: Initialized, Role: FOLLOWER
I20260812 11:06:42.907276 2854 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45719 } }
I20260812 11:06:42.907399 2854 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:42.907467 2854 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:42.907563 2854 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:06:42.909662 2854 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45719 } }
I20260812 11:06:42.910023 2854 leader_election.cc:302] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d8adbc5997d4544aa0f6d45870ba5cb; no voters:
I20260812 11:06:42.910373 2854 leader_election.cc:288] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:06:42.910526 2864 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:06:42.910777 2864 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [term 2 LEADER]: Becoming Leader. State: Replica: 6d8adbc5997d4544aa0f6d45870ba5cb, State: Running, Role: LEADER
I20260812 11:06:42.911118 2864 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45719 } }
I20260812 11:06:42.911629 2854 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:42.912524 2865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45719 } } }
I20260812 11:06:42.912658 2865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:42.912993 2866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d8adbc5997d4544aa0f6d45870ba5cb. Latest consensus state: current_term: 2 leader_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d8adbc5997d4544aa0f6d45870ba5cb" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45719 } } }
I20260812 11:06:42.913080 2866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:42.913398 2878 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:42.916939 2878 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:42.917584 2878 catalog_manager.cc:1259] Loaded cluster ID: 194d6b75635d40618c24b2b44803088c
I20260812 11:06:42.917651 2878 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:42.919934 2878 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:42.920663 2878 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6d8adbc5997d4544aa0f6d45870ba5cb: Loaded TSK: 0
I20260812 11:06:42.921907 2878 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:06:42.994910 2862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:42.995186 2862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:42.995231 2862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:42.999362 2862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:42.999436 2862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:42.999504 2862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:43.005098 2862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.193.keytab
--principal=oryx/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:43493
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=34961
--tserver_master_addrs=127.18.174.254:45719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:43.006273 2862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:43.007339 2862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:43.017496 2902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:43.017623 2911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:43.017513 2903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:43.017843 2862 server_base.cc:1034] running on GCE node
I20260812 11:06:43.018312 2862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:43.018970 2862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:43.020143 2862 hybrid_clock.cc:648] HybridClock initialized: now 1786532803020104 us; error 58 us; skew 500 ppm
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532803, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:43.023070 2862 init.cc:377] Logged in from keytab as oryx/127.18.174.193@KRBTEST.COM (short username oryx)
I20260812 11:06:43.024060 2862 webserver.cc:460] Webserver started at http://127.18.174.193:34961/ using document root <none> and password file <none>
I20260812 11:06:43.024677 2862 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:43.024763 2862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:43.028851 2862 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:06:43.030965 2931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:43.032260 2862 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260812 11:06:43.032362 2862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "d345269cd93340d084d8bf8a94504ef9"
format_stamp: "Formatted at 2026-08-12 11:06:41 on dist-test-slave-lgr5"
server_key: "964237584300b18e4c434a517cc0e51e"
server_key_iv: "60a9be6e210cd07f1bcf3b9f60dc181d"
server_key_version: "encryptionkey@0"
I20260812 11:06:43.032907 2862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:43.046744 2862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:43.049985 2862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:43.050168 2862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:43.050788 2862 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:43.051885 2862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:43.051945 2862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:43.052003 2862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:43.052026 2862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:43.060678 2862 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:43493
I20260812 11:06:43.060702 3167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:43493 every 8 connection(s)
I20260812 11:06:43.061676 2862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:06:43.062769 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 2862
I20260812 11:06:43.063194 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:45935
--local_ip_for_outbound_sockets=127.18.174.194
--tserver_master_addrs=127.18.174.254:45719
--webserver_port=40871
--webserver_interface=127.18.174.194
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:36405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.18.174.194
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:06:43.075644 3173 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:43.063725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:51527 (local address 127.18.174.254:45719)
0812 11:06:43.064281 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:43.064300 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:43.065058 (+ 758us) server_negotiation.cc:407] Connection header received
0812 11:06:43.066584 (+ 1526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:43.066595 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:43.066900 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:43.067213 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:43.068445 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.069428 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.070568 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.071045 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.071203 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.074923 (+ 3720us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:51527: BlockingRecv error: recv got EOF from 127.18.174.193:51527 (error 108)
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":142,"threads_started":1}
I20260812 11:06:43.075700 3174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:43.063891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:51527)
0812 11:06:43.064880 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:43.064921 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:43.066156 (+ 1235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:43.067329 (+ 1173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:43.067338 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:43.067758 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:43.068269 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.068285 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.069569 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.069573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.070440 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.070450 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.071213 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.071217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.071398 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.072062 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:43.072108 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:43.074698 (+ 2590us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":814,"thread_start_us":151,"threads_started":1}
W20260812 11:06:43.076347 3168 heartbeater.cc:644] Failed to heartbeat to 127.18.174.254:45719 (0 consecutive failures): Not authorized: Failed to ping master at 127.18.174.254:45719: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:43.081875 3174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:43.076812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:54073)
0812 11:06:43.076933 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:43.076948 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:43.077022 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:43.077230 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:43.077232 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:43.077368 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:43.077465 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.077469 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.078472 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.078474 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.079026 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.079033 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.079565 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.079567 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.079633 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.080150 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:43.080162 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:43.081773 (+ 1611us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 11:06:43.082062 3173 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:43.076888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:54073 (local address 127.18.174.254:45719)
0812 11:06:43.077022 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:43.077027 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:43.077042 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:06:43.077087 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:43.077090 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:43.077138 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:43.077220 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:43.077569 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.078381 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.079120 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.079464 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.079566 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.081942 (+ 2376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:54073: BlockingRecv error: recv got EOF from 127.18.174.193:54073 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:43.087195 3174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:43.082552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:37599)
0812 11:06:43.082650 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:43.082664 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:43.082735 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:43.082940 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:43.082942 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:43.083072 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:43.083146 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.083150 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.084060 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.084062 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.084594 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.084602 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.085105 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.085108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.085159 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.085590 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:43.085601 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:43.087099 (+ 1498us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 11:06:43.087365 3173 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:43.082620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:37599 (local address 127.18.174.254:45719)
0812 11:06:43.082725 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:43.082729 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:43.082743 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:06:43.082806 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:43.082809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:43.082853 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:43.082915 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:43.083234 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.083971 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.084689 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.085010 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.085103 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.087253 (+ 2150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:37599: BlockingRecv error: recv got EOF from 127.18.174.193:37599 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260812 11:06:43.087627 3168 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:06:43.182013 3175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:43.182310 3175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:43.182364 3175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:43.186482 3175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:43.186554 3175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:43.186627 3175 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:06:43.192123 3175 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.194.keytab
--principal=oryx/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:45935
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=40871
--tserver_master_addrs=127.18.174.254:45719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:43.193243 3175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:43.194300 3175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:43.204524 3181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:43.204689 3183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:43.204643 3175 server_base.cc:1034] running on GCE node
W20260812 11:06:43.204553 3188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:43.205251 3175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:43.205938 3175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:43.207101 3175 hybrid_clock.cc:648] HybridClock initialized: now 1786532803207070 us; error 46 us; skew 500 ppm
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532803, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:43.209960 3175 init.cc:377] Logged in from keytab as oryx/127.18.174.194@KRBTEST.COM (short username oryx)
I20260812 11:06:43.210908 3175 webserver.cc:460] Webserver started at http://127.18.174.194:40871/ using document root <none> and password file <none>
I20260812 11:06:43.211508 3175 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:43.211634 3175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:43.215857 3175 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:43.218227 3201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:43.219525 3175 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:06:43.219647 3175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "59cd527567f4425e890876499f40cb68"
format_stamp: "Formatted at 2026-08-12 11:06:42 on dist-test-slave-lgr5"
server_key: "0fdf115c4eeb715ec1e2ee90a8483c3d"
server_key_iv: "980ebb137de10b5f8ca5556632d6dcff"
server_key_version: "encryptionkey@0"
I20260812 11:06:43.220288 3175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:43.233695 3175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:43.236760 3175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:43.236992 3175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:43.237648 3175 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:43.238516 3175 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:43.238564 3175 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:43.238617 3175 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:43.238651 3175 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:43.246999 3175 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:45935
I20260812 11:06:43.247015 3435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:45935 every 8 connection(s)
I20260812 11:06:43.248015 3175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:06:43.250504 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 3175
I20260812 11:06:43.250912 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:43855
--local_ip_for_outbound_sockets=127.18.174.195
--tserver_master_addrs=127.18.174.254:45719
--webserver_port=43071
--webserver_interface=127.18.174.195
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:36405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.18.174.195
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:06:43.260937 3173 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:43.249838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:48013 (local address 127.18.174.254:45719)
0812 11:06:43.250014 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:43.250019 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:43.250987 (+ 968us) server_negotiation.cc:407] Connection header received
0812 11:06:43.252461 (+ 1474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:43.252465 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:43.252545 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:43.252629 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:43.254276 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.254794 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.256530 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.256754 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.256837 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.260792 (+ 3955us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:48013: BlockingRecv error: recv got EOF from 127.18.174.194:48013 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:06:43.261581 3440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:43.250302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:48013)
0812 11:06:43.250804 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:43.250859 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:43.252207 (+ 1348us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:43.252864 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:43.252873 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:43.253390 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:43.254119 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.254141 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.254927 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.254930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.256391 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.256405 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.256918 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.256923 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.257140 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.257796 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:43.257820 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:43.260636 (+ 2816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":122,"threads_started":1}
W20260812 11:06:43.262105 3437 heartbeater.cc:644] Failed to heartbeat to 127.18.174.254:45719 (0 consecutive failures): Not authorized: Failed to ping master at 127.18.174.254:45719: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:43.267503 3440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:43.262544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:57161)
0812 11:06:43.262743 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:43.262754 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:43.262842 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:43.263073 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:43.263076 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:43.263262 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:43.263357 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.263363 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.264067 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.264071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.264638 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.264647 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.265061 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.265064 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.265151 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.265635 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:43.265647 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:43.267377 (+ 1730us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 11:06:43.267611 3173 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:43.262619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:57161 (local address 127.18.174.254:45719)
0812 11:06:43.262712 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:43.262716 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:43.262812 (+ 96us) server_negotiation.cc:407] Connection header received
0812 11:06:43.262932 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:43.262935 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:43.262981 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:43.263045 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:43.263470 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.263969 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.264750 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.264963 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.265049 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.267501 (+ 2452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:57161: BlockingRecv error: recv got EOF from 127.18.174.194:57161 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:43.273171 3440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:43.268017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:43375)
0812 11:06:43.268198 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:43.268211 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:43.268290 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:43.268518 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:43.268522 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:43.268679 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:43.268778 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.268786 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.269481 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.269484 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.270343 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.270352 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.270791 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.270795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.270883 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.271309 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:43.271323 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:43.273050 (+ 1727us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118}
W20260812 11:06:43.273274 3173 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:43.268116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:43375 (local address 127.18.174.254:45719)
0812 11:06:43.268212 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:43.268215 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:43.268250 (+ 35us) server_negotiation.cc:407] Connection header received
0812 11:06:43.268366 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:43.268368 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:43.268412 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:43.268474 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:43.268896 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.269373 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.270472 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.270693 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.270775 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.273179 (+ 2404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:43375: BlockingRecv error: recv got EOF from 127.18.174.194:43375 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260812 11:06:43.273473 3437 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:06:43.369838 3442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:43.370146 3442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:43.370210 3442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:43.374284 3442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:43.374358 3442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:43.374439 3442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:06:43.379926 3442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/krb5kdc/oryx_127.18.174.195.keytab
--principal=oryx/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:43855
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=43071
--tserver_master_addrs=127.18.174.254:45719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:43.381088 3442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:43.382122 3442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:43.391877 3455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:43.391948 3442 server_base.cc:1034] running on GCE node
W20260812 11:06:43.391852 3458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:43.391857 3453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:43.392580 3442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:43.393354 3442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:43.394534 3442 hybrid_clock.cc:648] HybridClock initialized: now 1786532803394514 us; error 34 us; skew 500 ppm
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532803, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:06:43.397495 3442 init.cc:377] Logged in from keytab as oryx/127.18.174.195@KRBTEST.COM (short username oryx)
I20260812 11:06:43.398559 3442 webserver.cc:460] Webserver started at http://127.18.174.195:43071/ using document root <none> and password file <none>
I20260812 11:06:43.399189 3442 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:43.399314 3442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:43.403734 3442 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:06:43.406208 3467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:43.407666 3442 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:06:43.407836 3442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "3d9adfcaebb04a919b3ddd324d3ec6a2"
format_stamp: "Formatted at 2026-08-12 11:06:42 on dist-test-slave-lgr5"
server_key: "9c0c7ab21649feb2747598a009a9c9fb"
server_key_iv: "0c0c8696c8a9b391c5df6cf83ca118d7"
server_key_version: "encryptionkey@0"
I20260812 11:06:43.408550 3442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:43.440903 3442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:43.443854 3442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:43.444065 3442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:43.444742 3442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:43.445710 3442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:43.445763 3442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:43.445822 3442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:43.445851 3442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:43.454986 3442 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:43855
I20260812 11:06:43.455026 3697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:43855 every 8 connection(s)
I20260812 11:06:43.456073 3442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:06:43.458787 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 3442
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:06:43.467510 3173 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:43.458024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:33255 (local address 127.18.174.254:45719)
0812 11:06:43.458171 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:43.458174 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:43.459102 (+ 928us) server_negotiation.cc:407] Connection header received
0812 11:06:43.461083 (+ 1981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:43.461086 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:43.461138 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:43.461212 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:43.462441 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.462964 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.464112 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.464321 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.464409 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.467366 (+ 2957us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:33255: BlockingRecv error: recv got EOF from 127.18.174.195:33255 (error 108)
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":56}
I20260812 11:06:43.467978 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:43.459752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35204 (local address 127.18.174.254:45719)
0812 11:06:43.459989 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:43.459992 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:43.460002 (+ 10us) server_negotiation.cc:407] Connection header received
0812 11:06:43.460039 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:43.460041 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:43.460104 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:43.460191 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:43.460967 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.461501 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.462346 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.462615 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.462703 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.464044 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:43.464050 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:43.464064 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:06:43.464128 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:43.465809 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:43.466246 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:43.466251 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:43.466256 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:43.466378 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:06:43.466659 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:06:43.466662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:06:43.466663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:06:43.467029 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:43.467216 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:43.467502 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 11:06:43.467848 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":163,"thread_start_us":80,"threads_started":1}
I20260812 11:06:43.468297 3703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:43.458409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:33255)
0812 11:06:43.458922 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:43.458976 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:43.460858 (+ 1882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:43.461415 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:43.461423 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:43.461773 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:43.462293 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.462308 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.463089 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.463092 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.463961 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.463971 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.464465 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.464469 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.464643 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.465072 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:43.465088 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:43.467249 (+ 2161us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":107,"threads_started":1}
W20260812 11:06:43.468777 3698 heartbeater.cc:644] Failed to heartbeat to 127.18.174.254:45719 (0 consecutive failures): Not authorized: Failed to ping master at 127.18.174.254:45719: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:43.473778 3703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:43.469199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:58139)
0812 11:06:43.469293 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:43.469306 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:43.469373 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:43.469576 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:43.469578 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:43.469697 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:43.469796 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.469803 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.470566 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.470569 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.471144 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.471153 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.471578 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.471582 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.471670 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.472096 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:43.472113 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:43.473652 (+ 1539us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 11:06:43.473898 3706 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:43.469277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:58139 (local address 127.18.174.254:45719)
0812 11:06:43.469381 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:43.469384 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:43.469422 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:06:43.469455 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:43.469457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:43.469496 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:43.469560 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:43.469891 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.470468 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.471250 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.471484 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.471566 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.473798 (+ 2232us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:58139: BlockingRecv error: recv got EOF from 127.18.174.195:58139 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:43 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:43.478565 3703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:43.474307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:57379)
0812 11:06:43.474421 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:43.474435 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:43.474508 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:43.474690 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:43.474692 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:43.474813 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:43.474886 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.474890 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.475524 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.475526 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.476022 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:43.476028 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.476412 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.476414 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:43.476471 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.476926 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:43.476936 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:43.478468 (+ 1532us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 11:06:43.478758 3706 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:43.474379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:57379 (local address 127.18.174.254:45719)
0812 11:06:43.474504 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:43.474507 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:43.474520 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:06:43.474573 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:43.474575 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:43.474609 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:43.474671 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:43.474971 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.475446 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.476129 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:43.476325 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:43.476404 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:43.478614 (+ 2210us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:57379: BlockingRecv error: recv got EOF from 127.18.174.195:57379 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260812 11:06:43.478765 3698 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 11:06:44 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:44 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:44.094128 3709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:44.088368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:43413)
0812 11:06:44.088659 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:44.088673 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:44.088775 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:44.089007 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:44.089009 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:44.089190 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:44.089294 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:44.089300 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:44.090007 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:44.090009 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:44.090596 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:44.090603 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:44.091130 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:44.091134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:44.091219 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:44.091921 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:44.091936 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:44.093994 (+ 2058us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":81,"threads_started":1}
W20260812 11:06:44.094271 3711 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:44.088449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:43413 (local address 127.18.174.254:45719)
0812 11:06:44.088705 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:44.088710 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:44.088724 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:06:44.088854 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:44.088856 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:44.088901 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:44.088981 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:44.089383 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:44.089924 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:44.090720 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:44.091015 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:44.091100 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:44.094147 (+ 3047us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:43413: BlockingRecv error: recv got EOF from 127.18.174.193:43413 (error 108)
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":88,"threads_started":1}
Aug 12 11:06:44 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:44 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:44.279520 3712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:44.274165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:56711)
0812 11:06:44.274448 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:44.274463 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:44.274584 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:44.274805 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:44.274807 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:44.274988 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:44.275103 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:44.275109 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:44.275820 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:44.275822 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:44.276436 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:44.276445 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:44.276845 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:44.276848 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:44.276919 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:44.277459 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:44.277472 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:44.279379 (+ 1907us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":81,"threads_started":1}
W20260812 11:06:44.279649 3711 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:44.274277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:56711 (local address 127.18.174.254:45719)
0812 11:06:44.274442 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:44.274446 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:44.274527 (+ 81us) server_negotiation.cc:407] Connection header received
0812 11:06:44.274658 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:44.274661 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:44.274705 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:44.274774 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:44.275197 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:44.275725 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:44.276537 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:44.276754 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:44.276837 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:44.279528 (+ 2691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:56711: BlockingRecv error: recv got EOF from 127.18.174.194:56711 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 12 11:06:44 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:44 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:44.485435 3714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:44.479463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:38955)
0812 11:06:44.479809 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:44.479823 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:44.479954 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:44.480328 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:44.480332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:44.480576 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:44.480703 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:44.480710 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:44.481479 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:44.481483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:44.482088 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:44.482097 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:44.482627 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:44.482631 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:44.482710 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:44.483263 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:44.483277 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:44.485285 (+ 2008us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":116,"threads_started":1}
W20260812 11:06:44.485648 3711 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:44.479574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:38955 (local address 127.18.174.254:45719)
0812 11:06:44.479708 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:44.479713 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:44.479914 (+ 201us) server_negotiation.cc:407] Connection header received
0812 11:06:44.480117 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:44.480121 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:44.480190 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:44.480274 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:44.480821 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:44.481376 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:44.482210 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:44.482455 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:44.482567 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:44.485500 (+ 2933us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:38955: BlockingRecv error: recv got EOF from 127.18.174.195:38955 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 12 11:06:45 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:45 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:45.100616 3716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:45.094924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:60883)
0812 11:06:45.095269 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:45.095286 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:45.095406 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:45.095692 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:45.095695 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:45.095894 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:45.095998 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:45.096004 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:45.096784 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:45.096788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:45.097355 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:45.097364 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:45.097807 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:45.097811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:45.097891 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:45.098385 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:45.098400 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:45.100386 (+ 1986us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":97,"threads_started":1}
W20260812 11:06:45.100692 3718 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:45.095037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:60883 (local address 127.18.174.254:45719)
0812 11:06:45.095292 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:45.095296 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:45.095365 (+ 69us) server_negotiation.cc:407] Connection header received
0812 11:06:45.095502 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:45.095510 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:45.095558 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:45.095640 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:45.096140 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:45.096676 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:45.097473 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:45.097702 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:45.097798 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:45.100571 (+ 2773us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:60883: BlockingRecv error: recv got EOF from 127.18.174.193:60883 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":90,"threads_started":1}
Aug 12 11:06:45 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:45 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:45.288405 3719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:45.280418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:60943)
0812 11:06:45.280690 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:45.280704 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:45.280815 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:45.281053 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:45.281055 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:45.281252 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:45.281357 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:45.281363 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:45.282069 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:45.282071 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:45.282634 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:45.282641 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:45.283002 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:45.283005 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:45.283064 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:45.286352 (+ 3288us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:45.286365 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:45.288237 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":77,"threads_started":1}
W20260812 11:06:45.288547 3718 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:45.280519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:60943 (local address 127.18.174.254:45719)
0812 11:06:45.280651 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:45.280655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:45.280769 (+ 114us) server_negotiation.cc:407] Connection header received
0812 11:06:45.280888 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:45.280890 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:45.280935 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:45.281017 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:45.281458 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:45.281984 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:45.282717 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:45.282921 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:45.282989 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:45.288420 (+ 5431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:60943: BlockingRecv error: recv got EOF from 127.18.174.194:60943 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 12 11:06:45 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:45 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:45.491802 3720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:45.486347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:52815)
0812 11:06:45.486799 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:45.486818 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:45.486944 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:45.487227 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:45.487229 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:45.487467 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:45.487587 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:45.487596 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:45.488366 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:45.488368 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:45.488930 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:45.488939 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:45.489328 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:45.489330 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:45.489387 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:45.489858 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:45.489869 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:45.491649 (+ 1780us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":76,"threads_started":1}
W20260812 11:06:45.491895 3718 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:45.486572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:52815 (local address 127.18.174.254:45719)
0812 11:06:45.486701 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:45.486705 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:45.486889 (+ 184us) server_negotiation.cc:407] Connection header received
0812 11:06:45.487053 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:45.487056 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:45.487105 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:45.487187 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:45.487700 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:45.488272 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:45.489030 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:45.489248 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:45.489318 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:45.491794 (+ 2476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:52815: BlockingRecv error: recv got EOF from 127.18.174.195:52815 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 11:06:46 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:46 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:46.106882 3721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:46.101414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:44899)
0812 11:06:46.101764 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:46.101779 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:46.101893 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:46.102157 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:46.102160 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:46.102363 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:46.102466 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:46.102481 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:46.103252 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:46.103256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:46.103821 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:46.103830 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:46.104351 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:46.104355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:46.104443 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:46.104973 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:46.104987 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:46.106756 (+ 1769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":85,"threads_started":1}
W20260812 11:06:46.107048 3724 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:46.101493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:44899 (local address 127.18.174.254:45719)
0812 11:06:46.101767 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:46.101772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:46.101836 (+ 64us) server_negotiation.cc:407] Connection header received
0812 11:06:46.101996 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:46.101998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:46.102042 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:46.102117 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:46.102596 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:46.103142 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:46.103943 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:46.104235 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:46.104330 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:46.106905 (+ 2575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:44899: BlockingRecv error: recv got EOF from 127.18.174.193:44899 (error 108)
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":97,"threads_started":1}
Aug 12 11:06:46 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:46 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:46.297025 3725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:46.289123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:46621)
0812 11:06:46.289387 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:46.289400 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:46.289515 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:46.289739 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:46.289741 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:46.289924 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:46.290040 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:46.290046 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:46.290709 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:46.290711 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:46.291279 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:46.291286 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:46.291634 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:46.291636 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:46.291693 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:46.294945 (+ 3252us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:46.294959 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:46.296862 (+ 1903us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":70,"threads_started":1}
W20260812 11:06:46.297232 3724 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:46.289217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:46621 (local address 127.18.174.254:45719)
0812 11:06:46.289373 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:46.289378 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:46.289467 (+ 89us) server_negotiation.cc:407] Connection header received
0812 11:06:46.289602 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:46.289604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:46.289652 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:46.289707 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:46.290124 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:46.290632 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:46.291355 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:46.291559 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:46.291624 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:46.297124 (+ 5500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:46621: BlockingRecv error: recv got EOF from 127.18.174.194:46621 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 12 11:06:46 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:46 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:46.499814 3729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:46.492692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:57343)
0812 11:06:46.492990 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:46.493008 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:46.493132 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:46.493390 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:46.493393 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:46.493637 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:46.493771 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:46.493780 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:46.494835 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:46.494839 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:46.495754 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:46.495767 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:46.496376 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:46.496381 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:46.496478 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:46.497077 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:46.497094 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:46.499645 (+ 2551us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":94,"threads_started":1}
W20260812 11:06:46.499867 3724 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:46.493060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:57343 (local address 127.18.174.254:45719)
0812 11:06:46.493185 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:46.493189 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:46.493203 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:06:46.493241 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:46.493244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:46.493289 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:46.493355 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:46.493892 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:46.494710 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:46.495876 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:46.496256 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:46.496355 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:46.499770 (+ 3415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:57343: BlockingRecv error: recv got EOF from 127.18.174.195:57343 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 12 11:06:47 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:47 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:47.113421 3732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:47.107712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:41679)
0812 11:06:47.108004 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:47.108018 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:47.108139 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:47.108486 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:47.108489 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:47.108675 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:47.108805 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:47.108811 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:47.109641 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:47.109643 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:47.110205 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:47.110213 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:47.110609 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:47.110611 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:47.110667 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:47.111124 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:47.111134 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:47.113287 (+ 2153us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":88,"threads_started":1}
W20260812 11:06:47.113834 3733 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:47.107824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:41679 (local address 127.18.174.254:45719)
0812 11:06:47.108064 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:47.108068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:47.108106 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:06:47.108229 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:47.108231 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:47.108280 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:47.108370 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:47.108956 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:47.109534 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:47.110310 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:47.110527 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:47.110598 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:47.113659 (+ 3061us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:41679: BlockingRecv error: recv got EOF from 127.18.174.193:41679 (error 108)
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":61,"threads_started":1}
Aug 12 11:06:47 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:47 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:47.303985 3735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:47.298175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:56693)
0812 11:06:47.298485 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:47.298505 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:47.298655 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:47.298916 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:47.298918 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:47.299114 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:47.299223 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:47.299229 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:47.299991 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:47.299995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:47.300641 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:47.300654 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:47.301164 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:47.301169 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:47.301246 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:47.301828 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:47.301845 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:47.303860 (+ 2015us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":128,"threads_started":1}
W20260812 11:06:47.304188 3733 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:47.298235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:56693 (local address 127.18.174.254:45719)
0812 11:06:47.298413 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:47.298417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:47.298618 (+ 201us) server_negotiation.cc:407] Connection header received
0812 11:06:47.298745 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:47.298748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:47.298800 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:47.298875 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:47.299349 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:47.299869 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:47.300806 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:47.301038 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:47.301127 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:47.304028 (+ 2901us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:56693: BlockingRecv error: recv got EOF from 127.18.174.194:56693 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 12 11:06:47 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:47 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:47.506235 3736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:47.500830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:43959)
0812 11:06:47.501098 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:47.501112 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:47.501220 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:47.501443 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:47.501445 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:47.501626 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:47.501725 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:47.501730 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:47.502437 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:47.502440 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:47.503000 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:47.503008 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:47.503582 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:47.503586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:47.503688 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:47.504295 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:47.504310 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:47.506112 (+ 1802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":75,"threads_started":1}
W20260812 11:06:47.506393 3733 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:47.500994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:43959 (local address 127.18.174.254:45719)
0812 11:06:47.501145 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:47.501149 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:47.501164 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:06:47.501297 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:47.501299 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:47.501346 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:47.501410 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:47.501811 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:47.502345 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:47.503127 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:47.503445 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:47.503553 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:47.506264 (+ 2711us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:43959: BlockingRecv error: recv got EOF from 127.18.174.195:43959 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 11:06:48 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:48 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:48.119341 3737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:48.114176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:50301)
0812 11:06:48.114449 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:48.114462 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:48.114581 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:48.114792 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:48.114794 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:48.114985 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:48.115098 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:48.115103 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:48.115898 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:48.115901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:48.116504 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:48.116514 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:48.116893 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:48.116895 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:48.116953 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:48.117465 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:48.117495 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:48.119210 (+ 1715us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":78,"threads_started":1}
W20260812 11:06:48.119604 3738 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:48.114246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:50301 (local address 127.18.174.254:45719)
0812 11:06:48.114468 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:48.114472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:48.114534 (+ 62us) server_negotiation.cc:407] Connection header received
0812 11:06:48.114646 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:48.114649 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:48.114691 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:48.114766 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:48.115229 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:48.115791 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:48.116596 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:48.116815 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:48.116881 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:48.119469 (+ 2588us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:50301: BlockingRecv error: recv got EOF from 127.18.174.193:50301 (error 108)
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":66,"threads_started":1}
Aug 12 11:06:48 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:48 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:48.309892 3740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:48.304865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:53529)
0812 11:06:48.305157 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:48.305171 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:48.305269 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:48.305490 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:48.305492 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:48.305676 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:48.305774 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:48.305779 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:48.306507 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:48.306510 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:48.307074 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:48.307083 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:48.307452 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:48.307455 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:48.307529 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:48.308020 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:48.308031 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:48.309767 (+ 1736us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":103,"threads_started":1}
W20260812 11:06:48.310173 3738 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:48.305016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:53529 (local address 127.18.174.254:45719)
0812 11:06:48.305153 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:48.305157 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:48.305233 (+ 76us) server_negotiation.cc:407] Connection header received
0812 11:06:48.305344 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:48.305346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:48.305388 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:48.305458 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:48.305859 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:48.306394 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:48.307161 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:48.307372 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:48.307440 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:48.309986 (+ 2546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:53529: BlockingRecv error: recv got EOF from 127.18.174.194:53529 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 12 11:06:48 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:48 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:48.512642 3743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:48.507084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:42187)
0812 11:06:48.507367 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:48.507400 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:48.507524 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:48.507779 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:48.507782 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:48.507994 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:48.508135 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:48.508145 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:48.508909 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:48.508913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:48.509474 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:48.509483 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:48.509928 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:48.509931 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:48.510011 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:48.510507 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:48.510519 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:48.512469 (+ 1950us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":90,"threads_started":1}
W20260812 11:06:48.512817 3738 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:48.507198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:42187 (local address 127.18.174.254:45719)
0812 11:06:48.507367 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:48.507372 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:48.507476 (+ 104us) server_negotiation.cc:407] Connection header received
0812 11:06:48.507615 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:48.507618 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:48.507669 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:48.507739 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:48.508256 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:48.508795 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:48.509589 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:48.509818 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:48.509917 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:48.512666 (+ 2749us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:42187: BlockingRecv error: recv got EOF from 127.18.174.195:42187 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 12 11:06:49 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:49 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:49.125579 3744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:49.120133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:51299)
0812 11:06:49.120413 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:49.120427 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:49.120522 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:49.120825 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:49.120828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:49.121031 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:49.121144 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:49.121150 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:49.121919 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:49.121922 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:49.122486 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:49.122495 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:49.122990 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:49.122994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:49.123069 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:49.123579 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:49.123593 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:49.125451 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":88,"threads_started":1}
W20260812 11:06:49.125742 3746 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:49.120236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:51299 (local address 127.18.174.254:45719)
0812 11:06:49.120462 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:49.120466 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:49.120500 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:06:49.120603 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:49.120605 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:49.120651 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:49.120728 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:49.121255 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:49.121797 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:49.122604 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:49.122843 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:49.122923 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:49.125609 (+ 2686us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:51299: BlockingRecv error: recv got EOF from 127.18.174.193:51299 (error 108)
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":56,"threads_started":1}
Aug 12 11:06:49 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:49 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:49.316231 3750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:49.310682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:46357)
0812 11:06:49.310967 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:49.311002 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:49.311127 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:49.311386 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:49.311389 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:49.311608 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:49.311706 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:49.311712 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:49.312652 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:49.312656 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:49.313236 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:49.313248 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:49.313704 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:49.313708 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:49.313786 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:49.314302 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:49.314315 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:49.316065 (+ 1750us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":90,"threads_started":1}
W20260812 11:06:49.316398 3746 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:49.310794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:46357 (local address 127.18.174.254:45719)
0812 11:06:49.310966 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:49.310971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:49.311075 (+ 104us) server_negotiation.cc:407] Connection header received
0812 11:06:49.311226 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:49.311229 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:49.311276 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:49.311347 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:49.311828 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:49.312547 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:49.313353 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:49.313599 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:49.313689 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:49.316269 (+ 2580us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:46357: BlockingRecv error: recv got EOF from 127.18.174.194:46357 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 12 11:06:49 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:49 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:49.518894 3753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:49.513407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:49619)
0812 11:06:49.513726 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:49.513742 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:49.513857 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:49.514079 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:49.514081 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:49.514262 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:49.514360 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:49.514365 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:49.515064 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:49.515066 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:49.515620 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:49.515627 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:49.516071 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:49.516075 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:49.516196 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:49.516731 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:49.516745 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:49.518777 (+ 2032us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":130,"threads_started":1}
W20260812 11:06:49.519073 3746 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:49.513499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:49619 (local address 127.18.174.254:45719)
0812 11:06:49.513635 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:49.513639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:49.513812 (+ 173us) server_negotiation.cc:407] Connection header received
0812 11:06:49.513928 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:49.513930 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:49.513978 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:49.514054 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:49.514447 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:49.514970 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:49.515734 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:49.515961 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:49.516047 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:49.518942 (+ 2895us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:49619: BlockingRecv error: recv got EOF from 127.18.174.195:49619 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 12 11:06:50 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:50 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:50.131876 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:50.126338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:57493)
0812 11:06:50.126665 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:50.126679 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:50.126785 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:50.126995 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:50.126997 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:50.127195 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:50.127300 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:50.127306 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:50.128113 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:50.128116 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:50.128687 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:50.128695 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:50.129074 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:50.129076 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:50.129132 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:50.129617 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:50.129628 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:50.131715 (+ 2087us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":74,"threads_started":1}
W20260812 11:06:50.132015 3756 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:50.126395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:57493 (local address 127.18.174.254:45719)
0812 11:06:50.126645 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:50.126649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:50.126742 (+ 93us) server_negotiation.cc:407] Connection header received
0812 11:06:50.126857 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:50.126859 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:50.126903 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:50.126991 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:50.127433 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:50.127985 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:50.128770 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:50.128993 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:50.129062 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:50.131876 (+ 2814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:57493: BlockingRecv error: recv got EOF from 127.18.174.193:57493 (error 108)
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":83,"threads_started":1}
Aug 12 11:06:50 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:50 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:50.327332 3757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:50.317078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:36391)
0812 11:06:50.317420 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:50.317435 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:50.317551 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:50.317803 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:50.317805 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:50.318003 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:50.318107 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:50.318113 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:50.318828 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:50.318831 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:50.319407 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:50.319417 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:50.319826 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:50.319828 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:50.319893 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:50.324930 (+ 5037us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:50.324949 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:50.327174 (+ 2225us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":89,"threads_started":1}
W20260812 11:06:50.327451 3756 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:50.317137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:36391 (local address 127.18.174.254:45719)
0812 11:06:50.317287 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:50.317291 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:50.317506 (+ 215us) server_negotiation.cc:407] Connection header received
0812 11:06:50.317627 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:50.317630 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:50.317687 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:50.317770 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:50.318202 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:50.318727 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:50.319509 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:50.319733 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:50.319812 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:50.327344 (+ 7532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:36391: BlockingRecv error: recv got EOF from 127.18.174.194:36391 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 11:06:50 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:50 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:50.525527 3759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:50.519746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:55849)
0812 11:06:50.520122 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:50.520135 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:50.520238 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:50.520479 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:50.520481 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:50.520662 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:50.520763 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:50.520769 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:50.521525 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:50.521527 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:50.522094 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:50.522102 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:50.522589 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:50.522591 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:50.522648 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:50.523168 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:50.523179 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:50.525382 (+ 2203us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":97,"threads_started":1}
W20260812 11:06:50.525657 3756 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:50.519905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:55849 (local address 127.18.174.254:45719)
0812 11:06:50.520048 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:50.520052 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:50.520200 (+ 148us) server_negotiation.cc:407] Connection header received
0812 11:06:50.520317 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:50.520320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:50.520373 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:50.520464 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:50.520877 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:50.521436 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:50.522218 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:50.522487 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:50.522582 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:50.525532 (+ 2950us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:55849: BlockingRecv error: recv got EOF from 127.18.174.195:55849 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 11:06:51 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:51 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:51.138649 3760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:51.132836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:55853)
0812 11:06:51.133134 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:51.133149 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:51.133252 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:51.133481 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:51.133484 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:51.133669 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:51.133775 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:51.133781 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:51.134634 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:51.134637 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:51.135228 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:51.135239 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:51.135767 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:51.135769 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:51.135846 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:51.136387 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:51.136403 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:51.138493 (+ 2090us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":81,"threads_started":1}
W20260812 11:06:51.138741 3762 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:51.133045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:55853 (local address 127.18.174.254:45719)
0812 11:06:51.133267 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:51.133270 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:51.133286 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:06:51.133327 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:51.133329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:51.133373 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:51.133451 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:51.133880 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:51.134511 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:51.135395 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:51.135659 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:51.135750 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:51.138623 (+ 2873us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:55853: BlockingRecv error: recv got EOF from 127.18.174.193:55853 (error 108)
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":63,"threads_started":1}
Aug 12 11:06:51 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:51 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:51.333536 3766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:51.328260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:50057)
0812 11:06:51.328550 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:51.328563 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:51.328676 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:51.328942 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:51.328945 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:51.329129 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:51.329232 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:51.329237 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:51.330134 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:51.330137 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:51.330723 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:51.330733 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:51.331117 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:51.331119 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:51.331176 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:51.331655 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:51.331666 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:51.333379 (+ 1713us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":74,"threads_started":1}
W20260812 11:06:51.333696 3762 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:51.328303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:50057 (local address 127.18.174.254:45719)
0812 11:06:51.328468 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:51.328483 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:51.328636 (+ 153us) server_negotiation.cc:407] Connection header received
0812 11:06:51.328778 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:51.328781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:51.328834 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:51.328901 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:51.329331 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:51.330025 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:51.330820 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:51.331037 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:51.331107 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:51.333593 (+ 2486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:50057: BlockingRecv error: recv got EOF from 127.18.174.194:50057 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 12 11:06:51 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:51 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:51.531880 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:51.526488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:50241)
0812 11:06:51.526806 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:51.526820 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:51.526939 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:51.527193 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:51.527195 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:51.527392 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:51.527510 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:51.527516 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:51.528292 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:51.528295 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:51.528858 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:51.528866 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:51.529368 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:51.529371 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:51.529453 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:51.529998 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:51.530013 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:51.531762 (+ 1749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":100,"threads_started":1}
W20260812 11:06:51.532018 3762 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:51.526585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:50241 (local address 127.18.174.254:45719)
0812 11:06:51.526777 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:51.526782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:51.526896 (+ 114us) server_negotiation.cc:407] Connection header received
0812 11:06:51.527034 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:51.527037 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:51.527090 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:51.527164 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:51.527622 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:51.528205 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:51.528975 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:51.529248 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:51.529363 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:51.531905 (+ 2542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:50241: BlockingRecv error: recv got EOF from 127.18.174.195:50241 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 12 11:06:52 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:52 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:52.145078 3770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:52.139430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:47509)
0812 11:06:52.139709 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:52.139723 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:52.139822 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:52.140138 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:52.140141 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:52.140334 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:52.140440 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:52.140446 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:52.141243 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:52.141245 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:52.141795 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:52.141801 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:52.142256 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:52.142258 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:52.142319 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:52.142867 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:52.142880 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:52.144886 (+ 2006us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":88,"threads_started":1}
W20260812 11:06:52.145170 3775 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:52.139516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:47509 (local address 127.18.174.254:45719)
0812 11:06:52.139761 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:52.139764 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:52.139780 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:06:52.139927 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:52.139930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:52.140000 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:52.140113 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:52.140584 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:52.141153 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:52.141914 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:52.142161 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:52.142246 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:52.145048 (+ 2802us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:47509: BlockingRecv error: recv got EOF from 127.18.174.193:47509 (error 108)
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":73,"threads_started":1}
Aug 12 11:06:52 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:52 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:52.339941 3779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:52.334377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:34123)
0812 11:06:52.334699 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:52.334715 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:52.334834 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:52.335090 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:52.335092 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:52.335302 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:52.335396 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:52.335403 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:52.336271 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:52.336274 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:52.336890 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:52.336900 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:52.337342 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:52.337345 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:52.337424 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:52.337954 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:52.337968 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:52.339798 (+ 1830us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":94,"threads_started":1}
W20260812 11:06:52.340062 3775 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:52.334435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:34123 (local address 127.18.174.254:45719)
0812 11:06:52.334567 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:52.334572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:52.334794 (+ 222us) server_negotiation.cc:407] Connection header received
0812 11:06:52.334923 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:52.334925 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:52.334974 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:52.335054 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:52.335533 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:52.336156 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:52.337003 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:52.337237 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:52.337328 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:52.339947 (+ 2619us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:34123: BlockingRecv error: recv got EOF from 127.18.174.194:34123 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 11:06:52 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:52 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:52.538757 3780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:52.532756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:33981)
0812 11:06:52.533063 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:52.533078 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:52.533186 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:52.533452 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:52.533454 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:52.533675 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:52.533784 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:52.533791 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:52.534624 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:52.534627 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:52.535376 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:52.535387 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:52.535958 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:52.535963 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:52.536047 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:52.536673 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:52.536686 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:52.538609 (+ 1923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":108,"threads_started":1}
W20260812 11:06:52.538930 3775 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:52.532932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:33981 (local address 127.18.174.254:45719)
0812 11:06:52.533064 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:52.533067 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:52.533133 (+ 66us) server_negotiation.cc:407] Connection header received
0812 11:06:52.533274 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:52.533276 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:52.533338 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:52.533423 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:52.533900 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:52.534517 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:52.535494 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:52.535826 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:52.535937 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:52.538799 (+ 2862us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:33981: BlockingRecv error: recv got EOF from 127.18.174.195:33981 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 12 11:06:53 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:53 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:53.151401 3783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:53.146019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:45099)
0812 11:06:53.146306 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:53.146320 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:53.146418 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:53.146674 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:53.146676 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:53.146863 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:53.146966 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:53.146971 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:53.147692 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:53.147695 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:53.148282 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:53.148290 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:53.148682 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:53.148684 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:53.148741 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:53.149279 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:53.149292 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:53.151246 (+ 1954us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":91,"threads_started":1}
W20260812 11:06:53.151537 3784 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:53.146145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:45099 (local address 127.18.174.254:45719)
0812 11:06:53.146377 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:53.146381 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:53.146404 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:06:53.146519 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:53.146521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:53.146567 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:53.146645 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:53.147061 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:53.147604 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:53.148368 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:53.148601 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:53.148672 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:53.151400 (+ 2728us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:45099: BlockingRecv error: recv got EOF from 127.18.174.193:45099 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":69,"threads_started":1}
Aug 12 11:06:53 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:53 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:53.345990 3790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:53.340751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:42443)
0812 11:06:53.341028 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:53.341042 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:53.341147 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:53.341398 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:53.341401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:53.341604 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:53.341710 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:53.341717 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:53.342540 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:53.342543 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:53.343094 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:53.343103 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:53.343523 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:53.343526 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:53.343596 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:53.344127 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:53.344138 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:53.345865 (+ 1727us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":75,"threads_started":1}
W20260812 11:06:53.346158 3784 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:53.340828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:42443 (local address 127.18.174.254:45719)
0812 11:06:53.341043 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:53.341047 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:53.341099 (+ 52us) server_negotiation.cc:407] Connection header received
0812 11:06:53.341224 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:53.341226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:53.341272 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:53.341339 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:53.341805 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:53.342426 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:53.343187 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:53.343400 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:53.343473 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:53.346034 (+ 2561us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:42443: BlockingRecv error: recv got EOF from 127.18.174.194:42443 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 12 11:06:53 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:53 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:53.544798 3793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:53.539525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:55505)
0812 11:06:53.539791 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:53.539804 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:53.539894 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:53.540147 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:53.540149 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:53.540330 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:53.540433 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:53.540438 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:53.541180 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:53.541183 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:53.541767 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:53.541776 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:53.542145 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:53.542147 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:53.542207 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:53.542753 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:53.542766 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:53.544672 (+ 1906us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":73,"threads_started":1}
W20260812 11:06:53.544960 3784 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:53.539685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:55505 (local address 127.18.174.254:45719)
0812 11:06:53.539842 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:53.539846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:53.539859 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:06:53.539970 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:53.539973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:53.540022 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:53.540108 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:53.540540 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:53.541056 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:53.541863 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:53.542067 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:53.542133 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:53.544828 (+ 2695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:55505: BlockingRecv error: recv got EOF from 127.18.174.195:55505 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 12 11:06:54 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:54 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:54.157416 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:54.152274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:51559)
0812 11:06:54.152556 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:54.152570 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:54.152666 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:54.152898 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:54.152900 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:54.153101 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:54.153204 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:54.153209 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:54.153933 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:54.153935 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:54.154499 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:54.154507 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:54.154894 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:54.154896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:54.154953 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:54.155449 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:54.155460 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:54.157267 (+ 1807us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":94,"threads_started":1}
W20260812 11:06:54.157614 3795 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:54.152351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:51559 (local address 127.18.174.254:45719)
0812 11:06:54.152622 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:54.152626 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:54.152641 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:06:54.152747 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:54.152749 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:54.152794 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:54.152874 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:54.153296 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:54.153847 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:54.154591 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:54.154809 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:54.154880 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:54.157472 (+ 2592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:51559: BlockingRecv error: recv got EOF from 127.18.174.193:51559 (error 108)
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":74,"threads_started":1}
Aug 12 11:06:54 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:54 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:54.352648 3797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:54.346890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:34859)
0812 11:06:54.347199 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:54.347215 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:54.347349 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:54.347612 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:54.347615 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:54.347850 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:54.347955 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:54.347963 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:54.348921 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:54.348924 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:54.349496 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:54.349505 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:54.349959 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:54.349963 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:54.350045 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:54.350571 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:54.350583 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:54.352518 (+ 1935us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":101,"threads_started":1}
W20260812 11:06:54.352960 3795 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:54.347023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:34859 (local address 127.18.174.254:45719)
0812 11:06:54.347194 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:54.347202 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:54.347295 (+ 93us) server_negotiation.cc:407] Connection header received
0812 11:06:54.347443 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:54.347446 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:54.347496 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:54.347567 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:54.348118 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:54.348808 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:54.349617 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:54.349852 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:54.349941 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:54.352729 (+ 2788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:34859: BlockingRecv error: recv got EOF from 127.18.174.194:34859 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 11:06:54 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:54 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:54.551220 3798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:54.545672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:34803)
0812 11:06:54.546020 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:54.546037 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:54.546174 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:54.546433 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:54.546436 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:54.546675 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:54.546776 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:54.546783 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:54.547549 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:54.547553 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:54.548272 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:54.548283 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:54.548772 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:54.548776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:54.548858 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:54.549367 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:54.549379 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:54.551104 (+ 1725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":111,"threads_started":1}
W20260812 11:06:54.551355 3795 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:54.545869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:34803 (local address 127.18.174.254:45719)
0812 11:06:54.546033 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:54.546038 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:54.546118 (+ 80us) server_negotiation.cc:407] Connection header received
0812 11:06:54.546267 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:54.546270 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:54.546321 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:54.546409 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:54.546901 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:54.547436 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:54.548387 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:54.548655 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:54.548755 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:54.551244 (+ 2489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:34803: BlockingRecv error: recv got EOF from 127.18.174.195:34803 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 11:06:55 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:55 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:55.163703 3801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:55.158307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:36407)
0812 11:06:55.158589 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:55.158602 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:55.158699 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:55.158965 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:55.158967 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:55.159163 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:55.159268 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:55.159273 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:55.159999 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:55.160002 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:55.160599 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:55.160607 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:55.161034 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:55.161036 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:55.161096 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:55.161646 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:55.161658 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:55.163554 (+ 1896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":75,"threads_started":1}
W20260812 11:06:55.163854 3802 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:55.158415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:36407 (local address 127.18.174.254:45719)
0812 11:06:55.158667 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:55.158671 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:55.158685 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:06:55.158778 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:55.158781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:55.158842 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:55.158936 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:55.159362 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:55.159898 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:55.160694 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:55.160936 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:55.161012 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:55.163717 (+ 2705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:36407: BlockingRecv error: recv got EOF from 127.18.174.193:36407 (error 108)
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":84,"threads_started":1}
Aug 12 11:06:55 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:55 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:55.361797 3807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:55.353352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:43049)
0812 11:06:55.353621 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:55.353635 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:55.353739 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:55.353938 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:55.353939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:55.354127 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:55.354223 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:55.354228 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:55.354927 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:55.354929 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:55.355492 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:55.355500 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:55.355905 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:55.355907 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:55.355970 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:55.359760 (+ 3790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:55.359777 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:55.361665 (+ 1888us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":72,"threads_started":1}
W20260812 11:06:55.361959 3802 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:55.353453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:43049 (local address 127.18.174.254:45719)
0812 11:06:55.353614 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:55.353618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:55.353698 (+ 80us) server_negotiation.cc:407] Connection header received
0812 11:06:55.353812 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:55.353814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:55.353859 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:55.353924 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:55.354305 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:55.354845 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:55.355590 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:55.355810 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:55.355887 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:55.361839 (+ 5952us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:43049: BlockingRecv error: recv got EOF from 127.18.174.194:43049 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 12 11:06:55 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:55 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:55.557282 3808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:55.551998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:59473)
0812 11:06:55.552298 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:55.552315 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:55.552423 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:55.552643 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:55.552645 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:55.552839 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:55.552944 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:55.552950 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:55.553652 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:55.553654 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:55.554222 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:55.554230 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:55.554671 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:55.554675 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:55.554749 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:55.555238 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:55.555249 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:55.557121 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":128,"threads_started":1}
W20260812 11:06:55.557389 3802 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:55.552119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:59473 (local address 127.18.174.254:45719)
0812 11:06:55.552254 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:55.552257 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:55.552378 (+ 121us) server_negotiation.cc:407] Connection header received
0812 11:06:55.552512 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:55.552514 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:55.552562 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:55.552629 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:55.553033 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:55.553568 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:55.554310 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:55.554537 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:55.554611 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:55.557284 (+ 2673us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:59473: BlockingRecv error: recv got EOF from 127.18.174.195:59473 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 11:06:56 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:56 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:56.170228 3809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:56.164569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:58295)
0812 11:06:56.164836 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:56.164850 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:56.164984 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:56.165269 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:56.165273 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:56.165536 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:56.165670 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:56.165679 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:56.166643 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:56.166645 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:56.167205 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:56.167214 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:56.167595 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:56.167598 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:56.167658 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:56.168211 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:56.168227 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:56.170070 (+ 1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":73,"threads_started":1}
W20260812 11:06:56.170347 3810 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:56.164658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:58295 (local address 127.18.174.254:45719)
0812 11:06:56.164911 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:56.164915 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:56.164930 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:06:56.165082 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:56.165084 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:56.165134 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:56.165239 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:56.165800 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:56.166530 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:56.167299 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:56.167516 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:56.167582 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:56.170227 (+ 2645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:58295: BlockingRecv error: recv got EOF from 127.18.174.193:58295 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":88,"threads_started":1}
Aug 12 11:06:56 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:56 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:56.368041 3811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:56.362657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:59095)
0812 11:06:56.362993 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:56.363009 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:56.363120 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:56.363352 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:56.363354 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:56.363540 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:56.363638 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:56.363644 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:56.364392 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:56.364394 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:56.364954 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:56.364962 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:56.365473 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:56.365478 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:56.365561 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:56.366124 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:56.366140 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:56.367901 (+ 1761us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":104,"threads_started":1}
W20260812 11:06:56.368197 3810 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:56.362824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:59095 (local address 127.18.174.254:45719)
0812 11:06:56.362986 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:56.362990 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:56.363084 (+ 94us) server_negotiation.cc:407] Connection header received
0812 11:06:56.363200 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:56.363203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:56.363250 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:56.363318 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:56.363732 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:56.364307 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:56.365062 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:56.365354 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:56.365441 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:56.368049 (+ 2608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:59095: BlockingRecv error: recv got EOF from 127.18.174.194:59095 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 12 11:06:56 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:56 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:56.564967 3813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:56.558128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:43491)
0812 11:06:56.558430 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:56.558447 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:56.558595 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:56.558898 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:56.558901 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:56.559142 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:56.559275 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:56.559285 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:56.560354 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:56.560358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:56.561257 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:56.561273 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:56.561826 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:56.561830 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:56.561927 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:56.562527 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:56.562545 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:56.564796 (+ 2251us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":82,"threads_started":1}
W20260812 11:06:56.565289 3810 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:56.558188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:43491 (local address 127.18.174.254:45719)
0812 11:06:56.558325 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:56.558330 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:56.558533 (+ 203us) server_negotiation.cc:407] Connection header received
0812 11:06:56.558698 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:56.558702 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:56.558760 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:56.558843 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:56.559389 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:56.560213 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:56.561376 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:56.561706 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:56.561799 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:56.564991 (+ 3192us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:43491: BlockingRecv error: recv got EOF from 127.18.174.195:43491 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 12 11:06:57 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:57 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:57.176841 3814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:57.171171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:48877)
0812 11:06:57.171503 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:57.171517 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:57.171619 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:57.171862 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:57.171864 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:57.172057 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:57.172187 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:57.172193 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:57.172926 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:57.172929 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:57.173538 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:57.173548 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:57.174034 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:57.174038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:57.174121 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:57.174679 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:57.174691 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:57.176699 (+ 2008us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":131,"threads_started":1}
W20260812 11:06:57.177027 3815 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:57.171292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:48877 (local address 127.18.174.254:45719)
0812 11:06:57.171594 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:57.171599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:57.171614 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:06:57.171705 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:57.171708 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:57.171755 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:57.171837 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:57.172276 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:57.172831 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:57.173663 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:57.173898 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:57.173980 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:57.176890 (+ 2910us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:48877: BlockingRecv error: recv got EOF from 127.18.174.193:48877 (error 108)
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":68,"threads_started":1}
Aug 12 11:06:57 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:57 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:57.374274 3817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:57.368874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:37881)
0812 11:06:57.369166 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:57.369182 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:57.369303 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:57.369568 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:57.369571 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:57.369771 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:57.369867 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:57.369874 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:57.370637 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:57.370641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:57.371220 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:57.371229 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:57.371672 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:57.371676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:57.371757 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:57.372264 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:57.372276 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:57.374139 (+ 1863us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":103,"threads_started":1}
W20260812 11:06:57.374399 3815 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:57.368985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:37881 (local address 127.18.174.254:45719)
0812 11:06:57.369156 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:57.369161 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:57.369254 (+ 93us) server_negotiation.cc:407] Connection header received
0812 11:06:57.369392 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:57.369395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:57.369445 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:57.369517 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:57.370005 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:57.370530 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:57.371337 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:57.371568 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:57.371655 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:57.374289 (+ 2634us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:37881: BlockingRecv error: recv got EOF from 127.18.174.194:37881 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 12 11:06:57 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:57 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.195@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:57.571256 3818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:57.565724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.195:55817)
0812 11:06:57.566127 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:57.566140 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:57.566243 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:57.566499 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:57.566501 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:57.566682 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:57.566781 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:57.566786 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:57.567534 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:57.567536 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:57.568156 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:57.568166 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:57.568652 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:57.568655 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:57.568716 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:57.569249 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:57.569262 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:57.571087 (+ 1825us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":99,"threads_started":1}
W20260812 11:06:57.571339 3815 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:57.565786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:55817 (local address 127.18.174.254:45719)
0812 11:06:57.565930 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:57.565935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:57.566205 (+ 270us) server_negotiation.cc:407] Connection header received
0812 11:06:57.566313 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:57.566316 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:57.566390 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:57.566457 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:57.566889 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:57.567436 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:57.568299 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:57.568547 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:57.568640 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:57.571234 (+ 2594us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.195:55817: BlockingRecv error: recv got EOF from 127.18.174.195:55817 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 12 11:06:58 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:58 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.193@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:58.183579 3822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:58.177846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.193:58315)
0812 11:06:58.178131 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:58.178146 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:58.178241 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:58.178498 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:58.178500 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:58.178685 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:58.178786 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:58.178792 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:58.179542 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:58.179545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:58.180304 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:58.180318 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:58.180887 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:58.180891 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:58.180972 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:58.181454 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:58.181466 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:58.183436 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":75,"threads_started":1}
W20260812 11:06:58.183732 3826 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:58.177934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:58315 (local address 127.18.174.254:45719)
0812 11:06:58.178182 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:58.178185 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:58.178200 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:06:58.178321 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:58.178323 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:58.178367 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:58.178452 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:58.178879 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:58.179401 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:58.180426 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:58.180757 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:58.180849 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:58.183606 (+ 2757us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.193:58315: BlockingRecv error: recv got EOF from 127.18.174.193:58315 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":86,"threads_started":1}
Aug 12 11:06:58 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:06:58 dist-test-slave-lgr5 krb5kdc[1668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.174.194@KRBTEST.COM for oryx/127.18.174.254@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:06:58.380872 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:58.375207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45719 (local address 127.18.174.194:52297)
0812 11:06:58.375535 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:58.375553 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:58.375688 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:58.375947 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:58.375950 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:58.376189 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:58.376290 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:58.376297 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:58.377063 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:58.377067 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:58.377640 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:58.377649 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:58.378107 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:58.378111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:58.378203 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:58.378723 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:06:58.378734 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:58.380707 (+ 1973us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.174.254:45719: Server oryx/127.18.174.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":117,"threads_started":1}
W20260812 11:06:58.380967 3826 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:58.375348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:52297 (local address 127.18.174.254:45719)
0812 11:06:58.375555 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:58.375560 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:58.375639 (+ 79us) server_negotiation.cc:407] Connection header received
0812 11:06:58.375784 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:58.375787 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:58.375834 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:58.375906 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:58.376415 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:58.376947 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:58.377760 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:58.377985 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:58.378075 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:58.380865 (+ 2790us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.174.194:52297: BlockingRecv error: recv got EOF from 127.18.174.194:52297 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 11:06:58.461750 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 2862
I20260812 11:06:58.485394 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 3175
I20260812 11:06:58.498375 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 3442
I20260812 11:06:58.514752 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 2723
2026-08-12T11:06:58Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18306 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T11:06:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:58Z Disabled control of system clock
I20260812 11:06:58.554544 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:34131
--webserver_interface=127.18.174.254
--webserver_port=0
--builtin_ntp_servers=127.18.174.212:36979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:34131
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 11:06:58.669047 3835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:58.669343 3835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:58.669378 3835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:58.673465 3835 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:58.673542 3835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:58.673556 3835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:58.673573 3835 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:58.673588 3835 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:58.678465 3835 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:34131
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:34131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:58.679620 3835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:58.681139 3835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:06:58.690367 3835 server_base.cc:1034] running on GCE node
W20260812 11:06:58.690388 3845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:58.690414 3852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:58.690388 3842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:58.691239 3835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:58.692487 3835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:58.693651 3835 hybrid_clock.cc:648] HybridClock initialized: now 1786532818693629 us; error 44 us; skew 500 ppm
I20260812 11:06:58.695538 3835 webserver.cc:460] Webserver started at http://127.18.174.254:32883/ using document root <none> and password file <none>
I20260812 11:06:58.696215 3835 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:58.696310 3835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:58.696545 3835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:58.698657 3835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "eedf43f5de0d45b4866e36ea12e18a3f"
format_stamp: "Formatted at 2026-08-12 11:06:58 on dist-test-slave-lgr5"
server_key: "255c61ef94ecb47c18197f840ca6972d"
server_key_iv: "6aad0cd6b13e5ebe4033bcba6651638b"
server_key_version: "encryptionkey@0"
I20260812 11:06:58.699235 3835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "eedf43f5de0d45b4866e36ea12e18a3f"
format_stamp: "Formatted at 2026-08-12 11:06:58 on dist-test-slave-lgr5"
server_key: "255c61ef94ecb47c18197f840ca6972d"
server_key_iv: "6aad0cd6b13e5ebe4033bcba6651638b"
server_key_version: "encryptionkey@0"
I20260812 11:06:58.702991 3835 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260812 11:06:58.705446 3867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:58.706655 3835 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:06:58.706774 3835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "eedf43f5de0d45b4866e36ea12e18a3f"
format_stamp: "Formatted at 2026-08-12 11:06:58 on dist-test-slave-lgr5"
server_key: "255c61ef94ecb47c18197f840ca6972d"
server_key_iv: "6aad0cd6b13e5ebe4033bcba6651638b"
server_key_version: "encryptionkey@0"
I20260812 11:06:58.706877 3835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:58.716964 3835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:58.717769 3835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:58.717967 3835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:58.725132 3835 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:34131
I20260812 11:06:58.725150 3971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:34131 every 8 connection(s)
I20260812 11:06:58.726109 3835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:58.729416 3972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:58.730962 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 3835
I20260812 11:06:58.731091 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:58.731398 19131 external_mini_cluster.cc:1428] Setting key 0f764bc5bec69e56323355ae268cbd07
I20260812 11:06:58.735872 3972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f: Bootstrap starting.
I20260812 11:06:58.738186 3972 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:58.738956 3972 log.cc:824] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:58.740679 3975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:58.732874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40038 (local address 127.18.174.254:34131)
0812 11:06:58.733554 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:58.733569 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:58.733605 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:06:58.734269 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:58.734287 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:58.734700 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:58.735029 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:58.735465 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:58.736492 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:58.737361 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:58.737845 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:58.738000 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:58.738823 (+ 823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:58.738829 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:58.738843 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:58.739269 (+ 426us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:58.739332 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:58.739355 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:58.739445 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:58.739586 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 11:06:58.739886 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":144,"threads_started":1}
I20260812 11:06:58.740999 3972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f: No bootstrap required, opened a new log
I20260812 11:06:58.744936 3972 raft_consensus.cc:348] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eedf43f5de0d45b4866e36ea12e18a3f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 34131 } }
I20260812 11:06:58.745196 3972 raft_consensus.cc:374] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:58.745257 3972 raft_consensus.cc:729] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eedf43f5de0d45b4866e36ea12e18a3f, State: Initialized, Role: FOLLOWER
I20260812 11:06:58.745692 3972 consensus_queue.cc:260] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eedf43f5de0d45b4866e36ea12e18a3f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 34131 } }
I20260812 11:06:58.745831 3972 raft_consensus.cc:388] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:58.745898 3972 raft_consensus.cc:482] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:58.746003 3972 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:58.746964 3972 raft_consensus.cc:504] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eedf43f5de0d45b4866e36ea12e18a3f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 34131 } }
I20260812 11:06:58.747313 3972 leader_election.cc:302] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eedf43f5de0d45b4866e36ea12e18a3f; no voters:
I20260812 11:06:58.747646 3972 leader_election.cc:288] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:58.747753 3977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:58.747961 3977 raft_consensus.cc:686] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [term 1 LEADER]: Becoming Leader. State: Replica: eedf43f5de0d45b4866e36ea12e18a3f, State: Running, Role: LEADER
I20260812 11:06:58.748392 3977 consensus_queue.cc:237] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eedf43f5de0d45b4866e36ea12e18a3f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 34131 } }
I20260812 11:06:58.749115 3972 sys_catalog.cc:564] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:58.750150 3978 sys_catalog.cc:455] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eedf43f5de0d45b4866e36ea12e18a3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eedf43f5de0d45b4866e36ea12e18a3f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 34131 } } }
I20260812 11:06:58.750280 3978 sys_catalog.cc:458] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:58.750674 3995 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:58.750972 3981 sys_catalog.cc:455] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader eedf43f5de0d45b4866e36ea12e18a3f. Latest consensus state: current_term: 1 leader_uuid: "eedf43f5de0d45b4866e36ea12e18a3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eedf43f5de0d45b4866e36ea12e18a3f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 34131 } } }
I20260812 11:06:58.751143 3981 sys_catalog.cc:458] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:58.753867 3995 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:58.760046 3995 catalog_manager.cc:1347] Generated new cluster ID: 87d1aa455e79435cbe5104d49318cfd1
I20260812 11:06:58.760159 3995 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:58.780167 3995 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:58.781896 3995 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:58.788990 3995 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eedf43f5de0d45b4866e36ea12e18a3f: Generated new TSK 0
I20260812 11:06:58.789716 3995 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:06:58.793821 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:34131
--builtin_ntp_servers=127.18.174.212:36979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 11:06:58.912048 4011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:58.912384 4011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:58.912429 4011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:58.916556 4011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:58.916620 4011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:58.916684 4011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:58.921548 4011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:34131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:58.922668 4011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:58.924145 4011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:58.934122 4024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:58.934281 4011 server_base.cc:1034] running on GCE node
W20260812 11:06:58.934144 4018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:58.934132 4019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:58.934835 4011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:58.935599 4011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:58.936758 4011 hybrid_clock.cc:648] HybridClock initialized: now 1786532818936735 us; error 35 us; skew 500 ppm
I20260812 11:06:58.938781 4011 webserver.cc:460] Webserver started at http://127.18.174.193:44017/ using document root <none> and password file <none>
I20260812 11:06:58.939383 4011 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:58.939461 4011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:58.939682 4011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:58.941969 4011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "c02c6e316e6043f1a64fe97a616ad4d3"
format_stamp: "Formatted at 2026-08-12 11:06:58 on dist-test-slave-lgr5"
server_key: "d3cc6337a9ffc320c3e2a25715a782c3"
server_key_iv: "1b847a6e26159c7d3438057956447c51"
server_key_version: "encryptionkey@0"
I20260812 11:06:58.942551 4011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "c02c6e316e6043f1a64fe97a616ad4d3"
format_stamp: "Formatted at 2026-08-12 11:06:58 on dist-test-slave-lgr5"
server_key: "d3cc6337a9ffc320c3e2a25715a782c3"
server_key_iv: "1b847a6e26159c7d3438057956447c51"
server_key_version: "encryptionkey@0"
I20260812 11:06:58.946446 4011 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260812 11:06:58.949128 4040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:58.950548 4011 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:58.950675 4011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "c02c6e316e6043f1a64fe97a616ad4d3"
format_stamp: "Formatted at 2026-08-12 11:06:58 on dist-test-slave-lgr5"
server_key: "d3cc6337a9ffc320c3e2a25715a782c3"
server_key_iv: "1b847a6e26159c7d3438057956447c51"
server_key_version: "encryptionkey@0"
I20260812 11:06:58.950788 4011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:58.965135 4011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:58.965873 4011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:58.966059 4011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:58.966683 4011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:58.967708 4011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:58.967758 4011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:58.967813 4011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:58.967844 4011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:58.976646 4011 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:39287
I20260812 11:06:58.976676 4239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:39287 every 8 connection(s)
I20260812 11:06:58.977615 4011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:06:58.981308 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 4011
I20260812 11:06:58.981432 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:06:58.981767 19131 external_mini_cluster.cc:1428] Setting key f9e6491d83d5e90ae9c8887d3f8da8e9
I20260812 11:06:58.983944 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:34131
--builtin_ntp_servers=127.18.174.212:36979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 11:06:58.988169 3975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:58.979574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:57439 (local address 127.18.174.254:34131)
0812 11:06:58.979714 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:58.979718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:58.980863 (+ 1145us) server_negotiation.cc:407] Connection header received
0812 11:06:58.982564 (+ 1701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:58.982568 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:58.982632 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:58.982712 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:58.983808 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:58.984441 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:58.985953 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:58.986182 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:58.986274 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:58.987605 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:58.987609 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:58.987612 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:58.987628 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:58.987654 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:58.987664 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:58.987736 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:58.987887 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 11:06:58.987979 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:06:58.989039 4242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:58.979986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:34131 (local address 127.18.174.193:57439)
0812 11:06:58.980711 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:58.980753 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:58.982340 (+ 1587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:58.982910 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:58.982918 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:58.983017 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:58.983646 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:58.983669 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:58.984578 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:58.984582 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:58.985830 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:58.985841 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:58.986338 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:58.986342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:58.986520 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:58.987265 (+ 745us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:06:58.987268 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:58.987326 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:06:58.987414 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:58.987747 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:58.987755 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:58.987760 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 11:06:58.987864 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 11:06:58.988161 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":127,"threads_started":1}
I20260812 11:06:58.990336 4240 heartbeater.cc:347] Connected to a master server at 127.18.174.254:34131
I20260812 11:06:58.990573 4240 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:58.991119 4240 heartbeater.cc:511] Master 127.18.174.254:34131 requested a full tablet report, sending...
I20260812 11:06:58.992697 3900 ts_manager.cc:194] Registered new tserver with Master: c02c6e316e6043f1a64fe97a616ad4d3 (127.18.174.193:39287)
I20260812 11:06:58.993839 3900 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.174.193:57439
W20260812 11:06:59.099079 4244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:59.099355 4244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:59.099395 4244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:59.103574 4244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:59.103643 4244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:59.103699 4244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:06:59.108600 4244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:34131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:59.109774 4244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:59.111414 4244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:59.121690 4252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:59.121732 4244 server_base.cc:1034] running on GCE node
W20260812 11:06:59.121690 4258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:59.121687 4254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:59.122404 4244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:59.123111 4244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:59.124275 4244 hybrid_clock.cc:648] HybridClock initialized: now 1786532819124250 us; error 37 us; skew 500 ppm
I20260812 11:06:59.126235 4244 webserver.cc:460] Webserver started at http://127.18.174.194:44273/ using document root <none> and password file <none>
I20260812 11:06:59.126885 4244 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:59.126973 4244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:59.127198 4244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:59.129444 4244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "37d8e8de47964dbf9c0c638170f446ee"
format_stamp: "Formatted at 2026-08-12 11:06:59 on dist-test-slave-lgr5"
server_key: "4d06528b0a6a022c1fe71ee81bb967d5"
server_key_iv: "2c001b4d89efe2399a061c4c759f74ef"
server_key_version: "encryptionkey@0"
I20260812 11:06:59.130038 4244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "37d8e8de47964dbf9c0c638170f446ee"
format_stamp: "Formatted at 2026-08-12 11:06:59 on dist-test-slave-lgr5"
server_key: "4d06528b0a6a022c1fe71ee81bb967d5"
server_key_iv: "2c001b4d89efe2399a061c4c759f74ef"
server_key_version: "encryptionkey@0"
I20260812 11:06:59.134008 4244 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:06:59.136847 4272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:59.138219 4244 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:06:59.138357 4244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "37d8e8de47964dbf9c0c638170f446ee"
format_stamp: "Formatted at 2026-08-12 11:06:59 on dist-test-slave-lgr5"
server_key: "4d06528b0a6a022c1fe71ee81bb967d5"
server_key_iv: "2c001b4d89efe2399a061c4c759f74ef"
server_key_version: "encryptionkey@0"
I20260812 11:06:59.138484 4244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:59.159835 4244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:59.160631 4244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:59.160821 4244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:59.161463 4244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:59.162490 4244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:59.162541 4244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:59.162598 4244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:59.162627 4244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:59.171213 4244 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:34371
I20260812 11:06:59.171240 4493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:34371 every 8 connection(s)
I20260812 11:06:59.172231 4244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:06:59.181053 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 4244
I20260812 11:06:59.181192 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:06:59.181527 19131 external_mini_cluster.cc:1428] Setting key 672c78a12040280635cd34c231934dff
I20260812 11:06:59.181921 3975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:59.174176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:35869 (local address 127.18.174.254:34131)
0812 11:06:59.174326 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:59.174330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:59.175573 (+ 1243us) server_negotiation.cc:407] Connection header received
0812 11:06:59.177038 (+ 1465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:59.177041 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:59.177094 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:59.177156 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:59.178096 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:59.178618 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:59.179833 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:59.180063 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:59.180178 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:59.181438 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:59.181442 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:59.181444 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:59.181458 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:59.181480 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:59.181489 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:59.181547 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:59.181736 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 11:06:59.181797 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:06:59.183066 4496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:59.174598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:34131 (local address 127.18.174.194:35869)
0812 11:06:59.175410 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:59.175455 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:59.176817 (+ 1362us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:59.177352 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:59.177360 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:59.177451 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:59.177974 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:59.177986 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:59.178758 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:59.178762 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:59.179717 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:59.179729 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:59.180254 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:59.180257 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:59.180440 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:59.181084 (+ 644us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:06:59.181086 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:59.181146 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:06:59.181244 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:59.181571 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:59.181581 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:59.181587 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:06:59.181727 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 11:06:59.182058 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":127,"threads_started":1}
I20260812 11:06:59.183827 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:34131
--builtin_ntp_servers=127.18.174.212:36979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 11:06:59.184291 4494 heartbeater.cc:347] Connected to a master server at 127.18.174.254:34131
I20260812 11:06:59.184551 4494 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:59.185098 4494 heartbeater.cc:511] Master 127.18.174.254:34131 requested a full tablet report, sending...
I20260812 11:06:59.186247 3900 ts_manager.cc:194] Registered new tserver with Master: 37d8e8de47964dbf9c0c638170f446ee (127.18.174.194:34371)
I20260812 11:06:59.186846 3900 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.174.194:35869
W20260812 11:06:59.301718 4500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:59.302019 4500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:59.302062 4500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:59.306205 4500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:59.306272 4500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:59.306331 4500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:06:59.311309 4500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:34131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:59.312546 4500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:59.313993 4500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:59.323904 4527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:59.323948 4500 server_base.cc:1034] running on GCE node
W20260812 11:06:59.323956 4513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:59.323932 4517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:59.324709 4500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:59.325345 4500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:59.326476 4500 hybrid_clock.cc:648] HybridClock initialized: now 1786532819326452 us; error 34 us; skew 500 ppm
I20260812 11:06:59.328552 4500 webserver.cc:460] Webserver started at http://127.18.174.195:39587/ using document root <none> and password file <none>
I20260812 11:06:59.329202 4500 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:59.329300 4500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:59.329582 4500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:59.331951 4500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "27310041cf1a4402866f630f8176fdd3"
format_stamp: "Formatted at 2026-08-12 11:06:59 on dist-test-slave-lgr5"
server_key: "bb222b34dced8ad84fa6c25669f43984"
server_key_iv: "11d2f1437b59a5525b6d576c2b626c61"
server_key_version: "encryptionkey@0"
I20260812 11:06:59.332572 4500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "27310041cf1a4402866f630f8176fdd3"
format_stamp: "Formatted at 2026-08-12 11:06:59 on dist-test-slave-lgr5"
server_key: "bb222b34dced8ad84fa6c25669f43984"
server_key_iv: "11d2f1437b59a5525b6d576c2b626c61"
server_key_version: "encryptionkey@0"
I20260812 11:06:59.336511 4500 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:06:59.339615 4541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:59.340961 4500 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:06:59.341085 4500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "27310041cf1a4402866f630f8176fdd3"
format_stamp: "Formatted at 2026-08-12 11:06:59 on dist-test-slave-lgr5"
server_key: "bb222b34dced8ad84fa6c25669f43984"
server_key_iv: "11d2f1437b59a5525b6d576c2b626c61"
server_key_version: "encryptionkey@0"
I20260812 11:06:59.341207 4500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:59.366540 4500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:59.367323 4500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:59.367523 4500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:59.368191 4500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:59.369227 4500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:59.369278 4500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:59.369335 4500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:59.369365 4500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:59.378402 4500 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:42715
I20260812 11:06:59.378430 4764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:42715 every 8 connection(s)
I20260812 11:06:59.379441 4500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:06:59.381955 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 4500
I20260812 11:06:59.382052 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:06:59.382313 19131 external_mini_cluster.cc:1428] Setting key 9108011ef6c7a0f2658ce87c43de13ae
I20260812 11:06:59.389580 3975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:59.381636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:36241 (local address 127.18.174.254:34131)
0812 11:06:59.381816 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:59.381821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:59.383172 (+ 1351us) server_negotiation.cc:407] Connection header received
0812 11:06:59.384876 (+ 1704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:59.384879 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:59.384931 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:59.384998 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:59.385957 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:59.386487 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:59.387716 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:06:59.387950 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:06:59.388032 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:59.389185 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:59.389188 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:59.389190 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:59.389204 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:59.389225 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:59.389233 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:59.389301 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:59.389404 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 11:06:59.389459 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:06:59.390491 4769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:59.382087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:34131 (local address 127.18.174.195:36241)
0812 11:06:59.382966 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:59.383030 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:59.384631 (+ 1601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:59.385177 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:59.385185 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:59.385282 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:59.385807 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:59.385820 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:59.386629 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:59.386632 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:59.387578 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:06:59.387589 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:06:59.388115 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:06:59.388120 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:06:59.388295 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:06:59.388906 (+ 611us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:06:59.388908 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:59.388952 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:06:59.389035 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:59.389300 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:59.389305 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:59.389309 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:06:59.389399 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 11:06:59.389646 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":149,"threads_started":1}
I20260812 11:06:59.391680 4767 heartbeater.cc:347] Connected to a master server at 127.18.174.254:34131
I20260812 11:06:59.391947 4767 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:59.392577 4767 heartbeater.cc:511] Master 127.18.174.254:34131 requested a full tablet report, sending...
I20260812 11:06:59.393669 3900 ts_manager.cc:194] Registered new tserver with Master: 27310041cf1a4402866f630f8176fdd3 (127.18.174.195:42715)
I20260812 11:06:59.394227 3900 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.174.195:36241
I20260812 11:06:59.396658 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 11:06:59.399509 3975 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:06:59.398560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40050 (local address 127.18.174.254:34131)
0812 11:06:59.398687 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:59.398692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:59.398851 (+ 159us) server_negotiation.cc:407] Connection header received
0812 11:06:59.398993 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:59.398997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:59.399044 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:59.399108 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:59.399382 (+ 274us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40050: BlockingRecv error: recv got EOF from 127.0.0.1:40050 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:06:59.399807 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 4011
I20260812 11:06:59.427711 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 4244
I20260812 11:06:59.462648 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 4500
I20260812 11:06:59.477557 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 3835
2026-08-12T11:06:59Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (968 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T11:06:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:06:59Z Disabled control of system clock
I20260812 11:06:59.522346 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:46263
--webserver_interface=127.18.174.254
--webserver_port=0
--builtin_ntp_servers=127.18.174.212:42715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:46263
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 11:06:59.636902 4784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:59.637217 4784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:59.637259 4784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:59.641386 4784 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:06:59.641460 4784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:59.641474 4784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:59.641505 4784 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:06:59.641531 4784 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:06:59.646556 4784 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:42715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:46263
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:46263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:59.647761 4784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:59.649271 4784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:59.658120 4798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:59.658105 4807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:59.658100 4799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:59.658368 4784 server_base.cc:1034] running on GCE node
I20260812 11:06:59.659009 4784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:59.660202 4784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:59.661367 4784 hybrid_clock.cc:648] HybridClock initialized: now 1786532819661346 us; error 32 us; skew 500 ppm
I20260812 11:06:59.663333 4784 webserver.cc:460] Webserver started at http://127.18.174.254:32797/ using document root <none> and password file <none>
I20260812 11:06:59.663923 4784 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:59.663998 4784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:59.664258 4784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:59.666433 4784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "7ff487fde40f4f879f65214a980761b5"
format_stamp: "Formatted at 2026-08-12 11:06:59 on dist-test-slave-lgr5"
server_key: "89318f28dd3af80a5ceca8f9d1c051f3"
server_key_iv: "f3244647d452680d5867ce9c0237dffd"
server_key_version: "encryptionkey@0"
I20260812 11:06:59.667026 4784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "7ff487fde40f4f879f65214a980761b5"
format_stamp: "Formatted at 2026-08-12 11:06:59 on dist-test-slave-lgr5"
server_key: "89318f28dd3af80a5ceca8f9d1c051f3"
server_key_iv: "f3244647d452680d5867ce9c0237dffd"
server_key_version: "encryptionkey@0"
I20260812 11:06:59.671005 4784 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:06:59.673604 4818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:59.674903 4784 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:06:59.675077 4784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "7ff487fde40f4f879f65214a980761b5"
format_stamp: "Formatted at 2026-08-12 11:06:59 on dist-test-slave-lgr5"
server_key: "89318f28dd3af80a5ceca8f9d1c051f3"
server_key_iv: "f3244647d452680d5867ce9c0237dffd"
server_key_version: "encryptionkey@0"
I20260812 11:06:59.675194 4784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:59.680074 4784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:59.680730 4784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:59.680899 4784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:59.687559 4784 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:46263
I20260812 11:06:59.687572 4932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:46263 every 8 connection(s)
I20260812 11:06:59.688648 4784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:06:59.692277 4936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:06:59.698159 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 4784
I20260812 11:06:59.698333 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:06:59.698637 19131 external_mini_cluster.cc:1428] Setting key a31ba502f710d22076c682d3fbea7bd9
I20260812 11:06:59.698813 4936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5: Bootstrap starting.
I20260812 11:06:59.701763 4936 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5: Neither blocks nor log segments found. Creating new log.
I20260812 11:06:59.702638 4936 log.cc:824] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5: Log is configured to *not* fsync() on all Append() calls
I20260812 11:06:59.704730 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:59.700137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40480 (local address 127.18.174.254:46263)
0812 11:06:59.700838 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:59.700856 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:59.700895 (+ 39us) server_negotiation.cc:407] Connection header received
0812 11:06:59.701596 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:59.701615 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:59.702024 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:59.702320 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:59.703153 (+ 833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:59.703160 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:59.703176 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:59.703190 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:59.703268 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:59.703294 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:59.703413 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:59.703492 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 11:06:59.703763 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":123,"threads_started":1}
I20260812 11:06:59.705148 4936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5: No bootstrap required, opened a new log
I20260812 11:06:59.708817 4936 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ff487fde40f4f879f65214a980761b5" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46263 } }
I20260812 11:06:59.709093 4936 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:06:59.709149 4936 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ff487fde40f4f879f65214a980761b5, State: Initialized, Role: FOLLOWER
I20260812 11:06:59.709734 4936 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ff487fde40f4f879f65214a980761b5" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46263 } }
I20260812 11:06:59.709892 4936 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:06:59.709964 4936 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:06:59.710062 4936 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:06:59.711067 4936 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ff487fde40f4f879f65214a980761b5" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46263 } }
I20260812 11:06:59.711434 4936 leader_election.cc:302] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ff487fde40f4f879f65214a980761b5; no voters:
I20260812 11:06:59.711778 4936 leader_election.cc:288] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:06:59.711858 4943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:06:59.712113 4943 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [term 1 LEADER]: Becoming Leader. State: Replica: 7ff487fde40f4f879f65214a980761b5, State: Running, Role: LEADER
I20260812 11:06:59.712795 4943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ff487fde40f4f879f65214a980761b5" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46263 } }
I20260812 11:06:59.713167 4936 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:06:59.714393 4948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ff487fde40f4f879f65214a980761b5. Latest consensus state: current_term: 1 leader_uuid: "7ff487fde40f4f879f65214a980761b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ff487fde40f4f879f65214a980761b5" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46263 } } }
I20260812 11:06:59.714543 4948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [sys.catalog]: This master's current role is: LEADER
I20260812 11:06:59.714903 4947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ff487fde40f4f879f65214a980761b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ff487fde40f4f879f65214a980761b5" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 46263 } } }
I20260812 11:06:59.715041 4947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5 [sys.catalog]: This master's current role is: LEADER
W20260812 11:06:59.717904 4967 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:06:59.717983 4967 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:06:59.718050 4960 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:06:59.718910 4960 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:06:59.724628 4960 catalog_manager.cc:1347] Generated new cluster ID: 02e1d502858246d482a7d9f5dbfbb89d
I20260812 11:06:59.724704 4960 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:06:59.769397 4960 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:06:59.769759 4960 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:06:59.777640 4960 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ff487fde40f4f879f65214a980761b5: Generated new TSK 0
I20260812 11:06:59.778360 4960 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:06:59.788434 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46263
--builtin_ntp_servers=127.18.174.212:42715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 11:06:59.905220 4976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:06:59.905503 4976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:06:59.905548 4976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:06:59.909711 4976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:06:59.909780 4976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:06:59.909850 4976 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:06:59.914932 4976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:42715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:06:59.916160 4976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:06:59.917606 4976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:06:59.927263 4985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:59.927273 4986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:06:59.927291 4990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:06:59.927376 4976 server_base.cc:1034] running on GCE node
I20260812 11:06:59.927973 4976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:06:59.928704 4976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:06:59.929878 4976 hybrid_clock.cc:648] HybridClock initialized: now 1786532819929857 us; error 35 us; skew 500 ppm
I20260812 11:06:59.931845 4976 webserver.cc:460] Webserver started at http://127.18.174.193:40883/ using document root <none> and password file <none>
I20260812 11:06:59.932503 4976 fs_manager.cc:359] Metadata directory not provided
I20260812 11:06:59.932578 4976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:06:59.932797 4976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:06:59.934962 4976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "c0380b23ae90493381241218c258320c"
format_stamp: "Formatted at 2026-08-12 11:06:59 on dist-test-slave-lgr5"
server_key: "9c1ff542a5a00b610a167dbe88e0ee0f"
server_key_iv: "36c10417dc34d190b24d685e4bd4298c"
server_key_version: "encryptionkey@0"
I20260812 11:06:59.935573 4976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "c0380b23ae90493381241218c258320c"
format_stamp: "Formatted at 2026-08-12 11:06:59 on dist-test-slave-lgr5"
server_key: "9c1ff542a5a00b610a167dbe88e0ee0f"
server_key_iv: "36c10417dc34d190b24d685e4bd4298c"
server_key_version: "encryptionkey@0"
I20260812 11:06:59.939445 4976 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:06:59.942174 4998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:59.943423 4976 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 11:06:59.943562 4976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "c0380b23ae90493381241218c258320c"
format_stamp: "Formatted at 2026-08-12 11:06:59 on dist-test-slave-lgr5"
server_key: "9c1ff542a5a00b610a167dbe88e0ee0f"
server_key_iv: "36c10417dc34d190b24d685e4bd4298c"
server_key_version: "encryptionkey@0"
I20260812 11:06:59.943677 4976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:06:59.948436 4976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:06:59.949095 4976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:06:59.949263 4976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:06:59.949836 4976 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:06:59.950807 4976 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:06:59.950855 4976 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:59.950907 4976 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:06:59.950935 4976 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:06:59.959524 4976 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:42331
I20260812 11:06:59.959546 5211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:42331 every 8 connection(s)
I20260812 11:06:59.961633 4976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:06:59.965751 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 4976
I20260812 11:06:59.965852 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:06:59.966121 19131 external_mini_cluster.cc:1428] Setting key b635df688f8a214b203c5794a2cac425
I20260812 11:06:59.968209 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:59.963587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:35775 (local address 127.18.174.254:46263)
0812 11:06:59.963727 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 11:06:59.963731 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:06:59.964913 (+ 1182us) server_negotiation.cc:407] Connection header received
0812 11:06:59.966352 (+ 1439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:06:59.966355 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:06:59.966406 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:06:59.966498 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:06:59.967748 (+ 1250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:06:59.967751 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:06:59.967753 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:06:59.967765 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:06:59.967785 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:06:59.967793 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:06:59.967862 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 11:06:59.968025 (+ 163us) server_negotiation.cc:299] Negotiation successful
0812 11:06:59.968061 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:06:59.968312 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46263
--builtin_ntp_servers=127.18.174.212:42715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 11:06:59.969404 5215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:06:59.963982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46263 (local address 127.18.174.193:35775)
0812 11:06:59.964753 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0812 11:06:59.964798 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:06:59.966107 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:06:59.966699 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:06:59.966709 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:06:59.966826 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:06:59.967451 (+ 625us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:06:59.967453 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:06:59.967510 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:06:59.967596 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:06:59.967873 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:06:59.967882 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:06:59.967888 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:06:59.968112 (+ 224us) client_negotiation.cc:240] Negotiation successful
0812 11:06:59.968396 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":129,"threads_started":1}
I20260812 11:06:59.970734 5213 heartbeater.cc:347] Connected to a master server at 127.18.174.254:46263
I20260812 11:06:59.970968 5213 heartbeater.cc:464] Registering TS with master...
I20260812 11:06:59.971494 5213 heartbeater.cc:511] Master 127.18.174.254:46263 requested a full tablet report, sending...
I20260812 11:06:59.973457 4853 ts_manager.cc:194] Registered new tserver with Master: c0380b23ae90493381241218c258320c (127.18.174.193:42331)
W20260812 11:07:00.086769 5216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:07:00.087067 5216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:07:00.087109 5216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:07:00.091271 5216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:07:00.091337 5216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:07:00.091395 5216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:07:00.096282 5216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:42715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:07:00.097429 5216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:07:00.098887 5216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:07:00.108871 5230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:07:00.108862 5227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:00.108984 5216 server_base.cc:1034] running on GCE node
W20260812 11:07:00.108862 5235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:00.109543 5216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:07:00.110208 5216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:07:00.111366 5216 hybrid_clock.cc:648] HybridClock initialized: now 1786532820111342 us; error 38 us; skew 500 ppm
I20260812 11:07:00.113588 5216 webserver.cc:460] Webserver started at http://127.18.174.194:43885/ using document root <none> and password file <none>
I20260812 11:07:00.114235 5216 fs_manager.cc:359] Metadata directory not provided
I20260812 11:07:00.114303 5216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:07:00.114533 5216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:07:00.116782 5216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "003498d7b9954a81b010a8ad54ab61f8"
format_stamp: "Formatted at 2026-08-12 11:07:00 on dist-test-slave-lgr5"
server_key: "08b6edca7ae68bb0c1fdc34faec66e6d"
server_key_iv: "46b04d72e0945044a7ed729c66d3d96a"
server_key_version: "encryptionkey@0"
I20260812 11:07:00.117367 5216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "003498d7b9954a81b010a8ad54ab61f8"
format_stamp: "Formatted at 2026-08-12 11:07:00 on dist-test-slave-lgr5"
server_key: "08b6edca7ae68bb0c1fdc34faec66e6d"
server_key_iv: "46b04d72e0945044a7ed729c66d3d96a"
server_key_version: "encryptionkey@0"
I20260812 11:07:00.121063 5216 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:07:00.123723 5248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:00.125008 5216 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:07:00.125139 5216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "003498d7b9954a81b010a8ad54ab61f8"
format_stamp: "Formatted at 2026-08-12 11:07:00 on dist-test-slave-lgr5"
server_key: "08b6edca7ae68bb0c1fdc34faec66e6d"
server_key_iv: "46b04d72e0945044a7ed729c66d3d96a"
server_key_version: "encryptionkey@0"
I20260812 11:07:00.125249 5216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:07:00.130025 5216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:07:00.130663 5216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:07:00.130834 5216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:07:00.131399 5216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:07:00.132386 5216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:07:00.132436 5216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:00.132489 5216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:07:00.132519 5216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:00.141026 5216 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:33319
I20260812 11:07:00.141067 5479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:33319 every 8 connection(s)
I20260812 11:07:00.141955 5216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:07:00.147511 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 5216
I20260812 11:07:00.147646 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:07:00.147941 19131 external_mini_cluster.cc:1428] Setting key 229cc7e050cca19aebd7e96584ec4447
I20260812 11:07:00.148283 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:00.143779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:54865 (local address 127.18.174.254:46263)
0812 11:07:00.143951 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:00.143956 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:00.145125 (+ 1169us) server_negotiation.cc:407] Connection header received
0812 11:07:00.146374 (+ 1249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:00.146377 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:00.146414 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:00.146488 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:07:00.147666 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:07:00.147671 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:07:00.147673 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:07:00.147689 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:07:00.147733 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:07:00.147744 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:07:00.147827 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:00.148025 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 11:07:00.148145 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:07:00.149281 5483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:00.144268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46263 (local address 127.18.174.194:54865)
0812 11:07:00.144970 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:00.145016 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:00.146196 (+ 1180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:00.146715 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:00.146724 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:00.146821 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:07:00.147369 (+ 548us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:07:00.147371 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:07:00.147415 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:07:00.147491 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:07:00.147863 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:07:00.147871 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:07:00.147876 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 11:07:00.148036 (+ 160us) client_negotiation.cc:240] Negotiation successful
0812 11:07:00.148285 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":117,"threads_started":1}
I20260812 11:07:00.150108 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46263
--builtin_ntp_servers=127.18.174.212:42715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 11:07:00.150388 5481 heartbeater.cc:347] Connected to a master server at 127.18.174.254:46263
I20260812 11:07:00.150643 5481 heartbeater.cc:464] Registering TS with master...
I20260812 11:07:00.151144 5481 heartbeater.cc:511] Master 127.18.174.254:46263 requested a full tablet report, sending...
I20260812 11:07:00.152311 4853 ts_manager.cc:194] Registered new tserver with Master: 003498d7b9954a81b010a8ad54ab61f8 (127.18.174.194:33319)
W20260812 11:07:00.268823 5484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:07:00.269107 5484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:07:00.269155 5484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:07:00.273265 5484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:07:00.273331 5484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:07:00.273393 5484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:07:00.278393 5484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:42715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:46263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:07:00.279590 5484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:07:00.281073 5484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:07:00.291669 5496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:07:00.291666 5495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:00.291720 5484 server_base.cc:1034] running on GCE node
W20260812 11:07:00.291659 5499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:00.292378 5484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:07:00.293051 5484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:07:00.294281 5484 hybrid_clock.cc:648] HybridClock initialized: now 1786532820294261 us; error 32 us; skew 500 ppm
I20260812 11:07:00.296445 5484 webserver.cc:460] Webserver started at http://127.18.174.195:33591/ using document root <none> and password file <none>
I20260812 11:07:00.297037 5484 fs_manager.cc:359] Metadata directory not provided
I20260812 11:07:00.297106 5484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:07:00.297291 5484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:07:00.299635 5484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "b054498b81cf46979f04ba65758c6648"
format_stamp: "Formatted at 2026-08-12 11:07:00 on dist-test-slave-lgr5"
server_key: "d1a8eb126bb46411272f6e27c2972d30"
server_key_iv: "11e19e6c883fa37b7db769a1773a99a4"
server_key_version: "encryptionkey@0"
I20260812 11:07:00.300289 5484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "b054498b81cf46979f04ba65758c6648"
format_stamp: "Formatted at 2026-08-12 11:07:00 on dist-test-slave-lgr5"
server_key: "d1a8eb126bb46411272f6e27c2972d30"
server_key_iv: "11e19e6c883fa37b7db769a1773a99a4"
server_key_version: "encryptionkey@0"
I20260812 11:07:00.304344 5484 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:07:00.307305 5519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:00.308629 5484 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:07:00.308738 5484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "b054498b81cf46979f04ba65758c6648"
format_stamp: "Formatted at 2026-08-12 11:07:00 on dist-test-slave-lgr5"
server_key: "d1a8eb126bb46411272f6e27c2972d30"
server_key_iv: "11e19e6c883fa37b7db769a1773a99a4"
server_key_version: "encryptionkey@0"
I20260812 11:07:00.308862 5484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:07:00.313522 5484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:07:00.314185 5484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:07:00.314360 5484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:07:00.314920 5484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:07:00.315877 5484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:07:00.315924 5484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:00.315961 5484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:07:00.315980 5484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:00.324383 5484 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:37351
I20260812 11:07:00.324410 5730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:37351 every 8 connection(s)
I20260812 11:07:00.325284 5484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:07:00.328059 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 5484
I20260812 11:07:00.328192 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:07:00.328528 19131 external_mini_cluster.cc:1428] Setting key fb82c138419e4e3b0d05440de8bd071a
I20260812 11:07:00.331499 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:00.327067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:53941 (local address 127.18.174.254:46263)
0812 11:07:00.327236 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:00.327240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:00.328317 (+ 1077us) server_negotiation.cc:407] Connection header received
0812 11:07:00.329887 (+ 1570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:00.329890 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:00.329936 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:00.330015 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:07:00.331134 (+ 1119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:07:00.331137 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:07:00.331139 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:07:00.331151 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:07:00.331171 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:07:00.331179 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:07:00.331249 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:00.331343 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 11:07:00.331379 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 11:07:00.332438 5736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:00.327454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:46263 (local address 127.18.174.195:53941)
0812 11:07:00.328150 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:00.328209 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:00.329672 (+ 1463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:00.330193 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:00.330200 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:00.330295 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:07:00.330876 (+ 581us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:07:00.330878 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:07:00.330920 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:07:00.330996 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:07:00.331242 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:07:00.331247 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:07:00.331251 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:07:00.331378 (+ 127us) client_negotiation.cc:240] Negotiation successful
0812 11:07:00.331607 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":110,"threads_started":1}
I20260812 11:07:00.333498 5732 heartbeater.cc:347] Connected to a master server at 127.18.174.254:46263
I20260812 11:07:00.333724 5732 heartbeater.cc:464] Registering TS with master...
I20260812 11:07:00.334146 5732 heartbeater.cc:511] Master 127.18.174.254:46263 requested a full tablet report, sending...
I20260812 11:07:00.335175 4853 ts_manager.cc:194] Registered new tserver with Master: b054498b81cf46979f04ba65758c6648 (127.18.174.195:37351)
I20260812 11:07:00.342432 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 11:07:00.345333 4940 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:07:00.344382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40482 (local address 127.18.174.254:46263)
0812 11:07:00.344526 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:00.344531 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:00.344699 (+ 168us) server_negotiation.cc:407] Connection header received
0812 11:07:00.344815 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:00.344818 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:00.344858 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:00.344924 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:07:00.345188 (+ 264us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40482: BlockingRecv error: recv got EOF from 127.0.0.1:40482 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:07:00.345448 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 4976
I20260812 11:07:00.370457 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 5216
I20260812 11:07:00.381323 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 5484
I20260812 11:07:00.396278 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 4784
2026-08-12T11:07:00Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (916 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:07:00 dist-test-slave-lgr5 krb5kdc[5752](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:07:00 dist-test-slave-lgr5 krb5kdc[5752](info): set up 2 sockets
Aug 12 11:07:00 dist-test-slave-lgr5 krb5kdc[5752](info): commencing operation
krb5kdc: starting...
W20260812 11:07:01.612061 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:07:01 dist-test-slave-lgr5 krb5kdc[5752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:07:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:07:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:07:01.739216 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:33689
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:32841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:33689
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:07:01.854027 5773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:07:01.854306 5773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:07:01.854362 5773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:07:01.858412 5773 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:07:01.858484 5773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:07:01.858512 5773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:07:01.858539 5773 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:07:01.858560 5773 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:07:01.864138 5773 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:32841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:33689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:33689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:07:01.865284 5773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:07:01.866364 5773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:07:01.875102 5773 server_base.cc:1034] running on GCE node
W20260812 11:07:01.875052 5786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:07:01.875072 5787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:07:01.875052 5789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:01.875867 5773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:07:01.877059 5773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:07:01.878249 5773 hybrid_clock.cc:648] HybridClock initialized: now 1786532821878220 us; error 39 us; skew 500 ppm
Aug 12 11:07:01 dist-test-slave-lgr5 krb5kdc[5752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532821, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:07:01.881016 5773 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:07:01.881922 5773 webserver.cc:460] Webserver started at http://127.18.174.254:36483/ using document root <none> and password file <none>
I20260812 11:07:01.882478 5773 fs_manager.cc:359] Metadata directory not provided
I20260812 11:07:01.882548 5773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:07:01.882763 5773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:07:01.884902 5773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "3f4de2f042db47d6a904021e3d4b0d36"
format_stamp: "Formatted at 2026-08-12 11:07:01 on dist-test-slave-lgr5"
server_key: "a8f310caa6b36f8157924935ba26f5ef"
server_key_iv: "0291a2a0cf96ed80fbc1b453d6e0d5f4"
server_key_version: "encryptionkey@0"
I20260812 11:07:01.885500 5773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "3f4de2f042db47d6a904021e3d4b0d36"
format_stamp: "Formatted at 2026-08-12 11:07:01 on dist-test-slave-lgr5"
server_key: "a8f310caa6b36f8157924935ba26f5ef"
server_key_iv: "0291a2a0cf96ed80fbc1b453d6e0d5f4"
server_key_version: "encryptionkey@0"
I20260812 11:07:01.889287 5773 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260812 11:07:01.891702 5806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:01.892987 5773 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:07:01.893114 5773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "3f4de2f042db47d6a904021e3d4b0d36"
format_stamp: "Formatted at 2026-08-12 11:07:01 on dist-test-slave-lgr5"
server_key: "a8f310caa6b36f8157924935ba26f5ef"
server_key_iv: "0291a2a0cf96ed80fbc1b453d6e0d5f4"
server_key_version: "encryptionkey@0"
I20260812 11:07:01.893219 5773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:07:01.908206 5773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:07:01.911480 5773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:07:01.911672 5773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:07:01.919399 5773 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:33689
I20260812 11:07:01.919406 5903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:33689 every 8 connection(s)
I20260812 11:07:01.920586 5773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:07:01.926016 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 5773
I20260812 11:07:01.926158 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:07:01.926455 19131 external_mini_cluster.cc:1428] Setting key 82d93ae08c9945ab7db8631f900cdfc5
I20260812 11:07:01.929895 5906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 11:07:01 dist-test-slave-lgr5 krb5kdc[5752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:07:01.937062 5906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36: Bootstrap starting.
I20260812 11:07:01.940167 5906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36: Neither blocks nor log segments found. Creating new log.
I20260812 11:07:01.941167 5906 log.cc:824] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36: Log is configured to *not* fsync() on all Append() calls
I20260812 11:07:01.942991 5912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:01.928159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33854 (local address 127.18.174.254:33689)
0812 11:07:01.928693 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:01.928717 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:01.928767 (+ 50us) server_negotiation.cc:407] Connection header received
0812 11:07:01.929595 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:01.929616 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:01.930058 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:01.930452 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:07:01.931282 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:01.932714 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:01.933968 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:01.934505 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:01.934632 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:01.937566 (+ 2934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:07:01.937572 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:07:01.937592 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:07:01.937630 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:07:01.939599 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:01.940123 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:01.940131 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:01.940138 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:01.940340 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:01.940614 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:01.940617 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:01.940619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:01.941189 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:07:01.941385 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:01.941661 (+ 276us) server_negotiation.cc:299] Negotiation successful
0812 11:07:01.941996 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":153,"threads_started":1}
I20260812 11:07:01.943667 5906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36: No bootstrap required, opened a new log
I20260812 11:07:01.947443 5906 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f4de2f042db47d6a904021e3d4b0d36" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33689 } }
I20260812 11:07:01.947693 5906 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:07:01.947737 5906 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f4de2f042db47d6a904021e3d4b0d36, State: Initialized, Role: FOLLOWER
I20260812 11:07:01.948185 5906 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f4de2f042db47d6a904021e3d4b0d36" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33689 } }
I20260812 11:07:01.948324 5906 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:07:01.948371 5906 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:07:01.948446 5906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:07:01.949399 5906 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f4de2f042db47d6a904021e3d4b0d36" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33689 } }
I20260812 11:07:01.949841 5906 leader_election.cc:302] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f4de2f042db47d6a904021e3d4b0d36; no voters:
I20260812 11:07:01.950150 5906 leader_election.cc:288] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:07:01.950281 5916 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:07:01.950501 5916 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [term 1 LEADER]: Becoming Leader. State: Replica: 3f4de2f042db47d6a904021e3d4b0d36, State: Running, Role: LEADER
I20260812 11:07:01.950835 5916 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f4de2f042db47d6a904021e3d4b0d36" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33689 } }
I20260812 11:07:01.951563 5906 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:07:01.952893 5917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f4de2f042db47d6a904021e3d4b0d36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f4de2f042db47d6a904021e3d4b0d36" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33689 } } }
I20260812 11:07:01.952916 5920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f4de2f042db47d6a904021e3d4b0d36. Latest consensus state: current_term: 1 leader_uuid: "3f4de2f042db47d6a904021e3d4b0d36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f4de2f042db47d6a904021e3d4b0d36" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33689 } } }
I20260812 11:07:01.953061 5917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [sys.catalog]: This master's current role is: LEADER
I20260812 11:07:01.953064 5920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36 [sys.catalog]: This master's current role is: LEADER
I20260812 11:07:01.953436 5933 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:07:01.956519 5933 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:07:01.962025 5933 catalog_manager.cc:1347] Generated new cluster ID: aef5ecd24cec4668ada862e327bdfad2
I20260812 11:07:01.962113 5933 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:07:01.998356 5933 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:07:01.999349 5933 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:07:02.012266 5933 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36: Generated new TSK 0
I20260812 11:07:02.013067 5933 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:07:02.048990 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33689
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:32841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:07:02.189740 5960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:07:02.190016 5960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:07:02.190062 5960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:07:02.194190 5960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:07:02.194258 5960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:07:02.194316 5960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:07:02.199659 5960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:32841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:07:02.200737 5960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:07:02.201715 5960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:07:02.211592 5967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:07:02.211601 5971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:02.211731 5960 server_base.cc:1034] running on GCE node
W20260812 11:07:02.211622 5969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:02.212306 5960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:07:02.212919 5960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:07:02.214080 5960 hybrid_clock.cc:648] HybridClock initialized: now 1786532822214060 us; error 32 us; skew 500 ppm
Aug 12 11:07:02 dist-test-slave-lgr5 krb5kdc[5752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532822, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:07:02.216722 5960 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:07:02.217625 5960 webserver.cc:460] Webserver started at http://127.18.174.193:42759/ using document root <none> and password file <none>
I20260812 11:07:02.218190 5960 fs_manager.cc:359] Metadata directory not provided
I20260812 11:07:02.218257 5960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:07:02.218465 5960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:07:02.220577 5960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "807447af09744f9a8d0ec5ee420d4628"
format_stamp: "Formatted at 2026-08-12 11:07:02 on dist-test-slave-lgr5"
server_key: "56cbde273b4d095ab618e24fefa83d70"
server_key_iv: "990c311b62f1ca475c7f112fd0a4e858"
server_key_version: "encryptionkey@0"
I20260812 11:07:02.221119 5960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "807447af09744f9a8d0ec5ee420d4628"
format_stamp: "Formatted at 2026-08-12 11:07:02 on dist-test-slave-lgr5"
server_key: "56cbde273b4d095ab618e24fefa83d70"
server_key_iv: "990c311b62f1ca475c7f112fd0a4e858"
server_key_version: "encryptionkey@0"
I20260812 11:07:02.224828 5960 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:07:02.227270 5982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:02.228633 5960 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260812 11:07:02.228751 5960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "807447af09744f9a8d0ec5ee420d4628"
format_stamp: "Formatted at 2026-08-12 11:07:02 on dist-test-slave-lgr5"
server_key: "56cbde273b4d095ab618e24fefa83d70"
server_key_iv: "990c311b62f1ca475c7f112fd0a4e858"
server_key_version: "encryptionkey@0"
I20260812 11:07:02.228857 5960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:07:02.251237 5960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:07:02.254371 5960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:07:02.254561 5960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:07:02.255190 5960 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:07:02.256072 5960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:07:02.256143 5960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:02.256201 5960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:07:02.256227 5960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:02.265467 5960 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:38253
I20260812 11:07:02.265501 6181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:38253 every 8 connection(s)
I20260812 11:07:02.266459 5960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:07:02.266808 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 5960
I20260812 11:07:02.266940 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:07:02.267272 19131 external_mini_cluster.cc:1428] Setting key 7ce1f40d116723709c32c865c582175a
Aug 12 11:07:02 dist-test-slave-lgr5 krb5kdc[5752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532822, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
I20260812 11:07:02.282420 5912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:02.268487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:49639 (local address 127.18.174.254:33689)
0812 11:07:02.268624 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:02.268628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:02.269800 (+ 1172us) server_negotiation.cc:407] Connection header received
0812 11:07:02.271406 (+ 1606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:02.271409 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:02.271460 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:02.271541 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:07:02.273227 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.273776 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.275577 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.275828 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.275911 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:02.278807 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:07:02.278811 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:07:02.278813 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:07:02.278841 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:07:02.280276 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:02.280790 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:02.280793 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:02.280795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:02.280878 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:02.281218 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:02.281222 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:02.281223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:02.281454 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:07:02.281572 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:02.282108 (+ 536us) server_negotiation.cc:299] Negotiation successful
0812 11:07:02.282254 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:07:02.283464 6185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:02.269083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:33689 (local address 127.18.174.193:49639)
0812 11:07:02.269626 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:02.269682 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:02.271131 (+ 1449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:02.271791 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:02.271801 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:02.272363 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:07:02.273060 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:02.273083 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.273933 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.273937 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:02.275437 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:02.275451 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.276001 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.276005 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:02.276263 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:02.276916 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:07:02.276940 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:07:02.278622 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:07:02.280393 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:07:02.280399 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:07:02.280418 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:07:02.280688 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:07:02.280965 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:07:02.280969 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:07:02.280986 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:07:02.281130 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:07:02.281583 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:07:02.281589 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:07:02.281853 (+ 264us) client_negotiation.cc:769] Sending connection context
0812 11:07:02.282033 (+ 180us) client_negotiation.cc:240] Negotiation successful
0812 11:07:02.282319 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":136,"threads_started":1}
I20260812 11:07:02.284962 6182 heartbeater.cc:347] Connected to a master server at 127.18.174.254:33689
I20260812 11:07:02.285223 6182 heartbeater.cc:464] Registering TS with master...
I20260812 11:07:02.285756 6182 heartbeater.cc:511] Master 127.18.174.254:33689 requested a full tablet report, sending...
I20260812 11:07:02.287509 5836 ts_manager.cc:194] Registered new tserver with Master: 807447af09744f9a8d0ec5ee420d4628 (127.18.174.193:38253)
I20260812 11:07:02.288740 5836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:49639
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:07:02.298403 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33689
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:32841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:07:02.412926 6189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:07:02.413200 6189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:07:02.413244 6189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:07:02.417421 6189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:07:02.417492 6189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:07:02.417562 6189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:07:02.422914 6189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:32841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:07:02.424010 6189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:07:02.425109 6189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:07:02.435084 6198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:07:02.435087 6197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:02.435292 6189 server_base.cc:1034] running on GCE node
W20260812 11:07:02.435079 6201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:02.435844 6189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:07:02.436564 6189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:07:02.437736 6189 hybrid_clock.cc:648] HybridClock initialized: now 1786532822437709 us; error 39 us; skew 500 ppm
Aug 12 11:07:02 dist-test-slave-lgr5 krb5kdc[5752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532822, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:07:02.440475 6189 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:07:02.441349 6189 webserver.cc:460] Webserver started at http://127.18.174.194:43907/ using document root <none> and password file <none>
I20260812 11:07:02.441887 6189 fs_manager.cc:359] Metadata directory not provided
I20260812 11:07:02.441946 6189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:07:02.442149 6189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:07:02.444255 6189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "78280045c0364305a15ddd80a3db8db2"
format_stamp: "Formatted at 2026-08-12 11:07:02 on dist-test-slave-lgr5"
server_key: "76019450656a3846b8a9612245eb4589"
server_key_iv: "5851717ed645273239d69fe632828521"
server_key_version: "encryptionkey@0"
I20260812 11:07:02.444820 6189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "78280045c0364305a15ddd80a3db8db2"
format_stamp: "Formatted at 2026-08-12 11:07:02 on dist-test-slave-lgr5"
server_key: "76019450656a3846b8a9612245eb4589"
server_key_iv: "5851717ed645273239d69fe632828521"
server_key_version: "encryptionkey@0"
I20260812 11:07:02.449395 6189 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:07:02.452850 6220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:02.457007 6189 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260812 11:07:02.457161 6189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "78280045c0364305a15ddd80a3db8db2"
format_stamp: "Formatted at 2026-08-12 11:07:02 on dist-test-slave-lgr5"
server_key: "76019450656a3846b8a9612245eb4589"
server_key_iv: "5851717ed645273239d69fe632828521"
server_key_version: "encryptionkey@0"
I20260812 11:07:02.457327 6189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:07:02.505671 6189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:07:02.508723 6189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:07:02.508888 6189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:07:02.509460 6189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:07:02.510304 6189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:07:02.510351 6189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:02.510391 6189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:07:02.510411 6189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:02.519022 6189 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:43945
I20260812 11:07:02.519047 6425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:43945 every 8 connection(s)
I20260812 11:07:02.519919 6189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:07:02.526839 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 6189
I20260812 11:07:02.526939 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:07:02.527222 19131 external_mini_cluster.cc:1428] Setting key 5c2bbe7a4f40126c92834b086fc16fa3
Aug 12 11:07:02 dist-test-slave-lgr5 krb5kdc[5752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532822, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:07:02.534067 5912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:02.521845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:47151 (local address 127.18.174.254:33689)
0812 11:07:02.522013 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:02.522017 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:02.522826 (+ 809us) server_negotiation.cc:407] Connection header received
0812 11:07:02.524201 (+ 1375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:02.524204 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:02.524254 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:02.524326 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:07:02.525487 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.526020 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.527135 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.527449 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.527559 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:02.530307 (+ 2748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:07:02.530311 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:07:02.530313 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:07:02.530341 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:07:02.531705 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:02.532308 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:02.532312 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:02.532314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:02.532414 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:02.532751 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:02.532755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:02.532756 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:02.532974 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:07:02.533140 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:02.533759 (+ 619us) server_negotiation.cc:299] Negotiation successful
0812 11:07:02.533896 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 11:07:02.534803 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:02.522211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:33689 (local address 127.18.174.194:47151)
0812 11:07:02.522671 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:02.522715 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:02.523970 (+ 1255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:02.524488 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:02.524495 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:02.524857 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:07:02.525365 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:02.525379 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.526108 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.526110 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:02.527023 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:02.527033 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.527595 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.527599 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:02.527795 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:02.528394 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:07:02.528412 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:07:02.530133 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:07:02.531822 (+ 1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:07:02.531828 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:07:02.531844 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:07:02.532196 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:07:02.532516 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:07:02.532518 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:07:02.532520 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:07:02.532659 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:07:02.533138 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:07:02.533145 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:07:02.533450 (+ 305us) client_negotiation.cc:769] Sending connection context
0812 11:07:02.533654 (+ 204us) client_negotiation.cc:240] Negotiation successful
0812 11:07:02.533928 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":113,"threads_started":1}
I20260812 11:07:02.535990 6427 heartbeater.cc:347] Connected to a master server at 127.18.174.254:33689
I20260812 11:07:02.536298 6427 heartbeater.cc:464] Registering TS with master...
I20260812 11:07:02.536933 6427 heartbeater.cc:511] Master 127.18.174.254:33689 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
I20260812 11:07:02.538146 5836 ts_manager.cc:194] Registered new tserver with Master: 78280045c0364305a15ddd80a3db8db2 (127.18.174.194:43945)
I20260812 11:07:02.538730 5836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:47151
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:07:02.555322 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33689
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:32841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:07:02.671130 6437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:07:02.671412 6437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:07:02.671463 6437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:07:02.675523 6437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:07:02.675604 6437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:07:02.675664 6437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:07:02.681273 6437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:32841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:07:02.682400 6437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:07:02.683509 6437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:07:02.693539 6445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:02.693624 6437 server_base.cc:1034] running on GCE node
W20260812 11:07:02.693545 6450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:07:02.693538 6448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:02.694247 6437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:07:02.694885 6437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:07:02.696045 6437 hybrid_clock.cc:648] HybridClock initialized: now 1786532822696017 us; error 43 us; skew 500 ppm
Aug 12 11:07:02 dist-test-slave-lgr5 krb5kdc[5752](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532822, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:07:02.698818 6437 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:07:02.699704 6437 webserver.cc:460] Webserver started at http://127.18.174.195:39105/ using document root <none> and password file <none>
I20260812 11:07:02.700300 6437 fs_manager.cc:359] Metadata directory not provided
I20260812 11:07:02.700363 6437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:07:02.700567 6437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:07:02.702584 6437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "45270413f3f64f71adaaa8e15f32a469"
format_stamp: "Formatted at 2026-08-12 11:07:02 on dist-test-slave-lgr5"
server_key: "6e0c13a58e160d1a6a422b00b5ce528d"
server_key_iv: "2a793f881e4f04772301ce716c9d9cbb"
server_key_version: "encryptionkey@0"
I20260812 11:07:02.703153 6437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "45270413f3f64f71adaaa8e15f32a469"
format_stamp: "Formatted at 2026-08-12 11:07:02 on dist-test-slave-lgr5"
server_key: "6e0c13a58e160d1a6a422b00b5ce528d"
server_key_iv: "2a793f881e4f04772301ce716c9d9cbb"
server_key_version: "encryptionkey@0"
I20260812 11:07:02.706717 6437 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260812 11:07:02.709282 6460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:02.710471 6437 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:07:02.710590 6437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "45270413f3f64f71adaaa8e15f32a469"
format_stamp: "Formatted at 2026-08-12 11:07:02 on dist-test-slave-lgr5"
server_key: "6e0c13a58e160d1a6a422b00b5ce528d"
server_key_iv: "2a793f881e4f04772301ce716c9d9cbb"
server_key_version: "encryptionkey@0"
I20260812 11:07:02.710685 6437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:07:02.735209 6437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:07:02.738798 6437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:07:02.739027 6437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:07:02.739675 6437 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:07:02.740630 6437 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:07:02.740682 6437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:02.740742 6437 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:07:02.740767 6437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:02.749579 6437 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:37239
I20260812 11:07:02.749600 6694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:37239 every 8 connection(s)
I20260812 11:07:02.750564 6437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:07:02.752642 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 6437
I20260812 11:07:02.752774 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:07:02.753144 19131 external_mini_cluster.cc:1428] Setting key 4426398fa43c27304068012a9fe478a7
Aug 12 11:07:02 dist-test-slave-lgr5 krb5kdc[5752](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532822, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:07:02.764927 5912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:02.752501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:47961 (local address 127.18.174.254:33689)
0812 11:07:02.752630 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:02.752634 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:02.753726 (+ 1092us) server_negotiation.cc:407] Connection header received
0812 11:07:02.755508 (+ 1782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:02.755511 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:02.755567 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:02.755637 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:07:02.756932 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.757466 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.758624 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.758852 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.758942 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:02.761497 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:07:02.761501 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:07:02.761503 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:07:02.761530 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:07:02.762795 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:02.763399 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:02.763402 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:02.763403 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:02.763499 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:02.763839 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:02.763841 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:02.763842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:02.764027 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:07:02.764123 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:02.764689 (+ 566us) server_negotiation.cc:299] Negotiation successful
0812 11:07:02.764799 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:07:02.765834 6698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:02.753026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:33689 (local address 127.18.174.195:47961)
0812 11:07:02.753570 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:02.753630 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:02.755286 (+ 1656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:02.755816 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:02.755824 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:02.756277 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:07:02.756787 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:02.756801 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.757595 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.757598 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:02.758500 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:02.758510 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.759008 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.759013 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:02.759191 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:02.759765 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:07:02.759782 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:07:02.761306 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:07:02.762919 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:07:02.762925 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:07:02.762938 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:07:02.763297 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:07:02.763595 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:07:02.763597 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:07:02.763599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:07:02.763756 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:07:02.764146 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:07:02.764152 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:07:02.764453 (+ 301us) client_negotiation.cc:769] Sending connection context
0812 11:07:02.764640 (+ 187us) client_negotiation.cc:240] Negotiation successful
0812 11:07:02.764922 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":147,"threads_started":1}
I20260812 11:07:02.766947 6696 heartbeater.cc:347] Connected to a master server at 127.18.174.254:33689
I20260812 11:07:02.767216 6696 heartbeater.cc:464] Registering TS with master...
I20260812 11:07:02.767812 6696 heartbeater.cc:511] Master 127.18.174.254:33689 requested a full tablet report, sending...
I20260812 11:07:02.768888 5836 ts_manager.cc:194] Registered new tserver with Master: 45270413f3f64f71adaaa8e15f32a469 (127.18.174.195:37239)
I20260812 11:07:02.769434 5836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:47961
I20260812 11:07:02.779377 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:07:02.787921 5912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:02.781344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33866 (local address 127.18.174.254:33689)
0812 11:07:02.781498 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:02.781503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:02.781677 (+ 174us) server_negotiation.cc:407] Connection header received
0812 11:07:02.781780 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:02.781782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:02.781827 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:02.781893 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:07:02.782537 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.783051 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.783848 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.784049 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.784149 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:02.785405 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:07:02.785409 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:07:02.785411 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:07:02.785436 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:07:02.786583 (+ 1147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:02.786948 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:02.786950 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:02.786952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:02.787020 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:02.787196 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:02.787198 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:02.787199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:02.787413 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:07:02.787526 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:02.787672 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 11:07:02.787766 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:07:02.790735 5836 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:07:02.793895 5836 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:07:02.808598 6721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:02.802695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:37239 (local address 127.0.0.1:54302)
0812 11:07:02.803410 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:02.803461 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:02.803608 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:02.804624 (+ 1016us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:02.804627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:02.804640 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:07:02.804707 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:02.804713 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.806052 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.806055 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:02.807122 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:02.807133 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.807987 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.807991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:02.808123 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:02.808166 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 11:07:02.808272 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 11:07:02.808422 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"mutex_wait_us":26,"spinlock_wait_cycles":3200,"thread_start_us":118,"threads_started":1}
I20260812 11:07:02.808723 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:02.802740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44010 (local address 127.18.174.194:43945)
0812 11:07:02.803901 (+ 1161us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:02.803911 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:02.803933 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:07:02.804014 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:02.804019 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:02.804248 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:02.804396 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:07:02.804695 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.805863 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.807317 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.808101 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.808291 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:02.808402 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:02.808457 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 11:07:02.808561 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1058,"thread_start_us":146,"threads_started":1}
I20260812 11:07:02.808598 6715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:02.802594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:43945 (local address 127.0.0.1:44010)
0812 11:07:02.803411 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:02.803461 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:02.803608 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:02.804384 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:02.804390 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:02.804412 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:07:02.804561 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:02.804568 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.806030 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.806033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:02.807216 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:02.807227 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.808228 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.808232 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:02.808332 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:02.808353 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 11:07:02.808410 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 11:07:02.808461 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"mutex_wait_us":49,"spinlock_wait_cycles":7168,"thread_start_us":73,"threads_started":1}
I20260812 11:07:02.809047 6716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:02.802929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:38253 (local address 127.0.0.1:35484)
0812 11:07:02.803820 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:02.803832 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:02.803908 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:02.804566 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:02.804570 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:02.804589 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:07:02.804713 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:02.804719 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.805700 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.805704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:02.807011 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:02.807023 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.808222 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.808226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:02.808698 (+ 472us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:02.808723 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:07:02.808795 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 11:07:02.808857 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":836,"mutex_wait_us":5,"thread_start_us":106,"threads_started":1}
I20260812 11:07:02.809208 6722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:02.803258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35484 (local address 127.18.174.193:38253)
0812 11:07:02.803901 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:02.803909 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:02.803934 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:07:02.804009 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:02.804014 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:02.804248 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:02.804396 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:07:02.804834 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.805585 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.807142 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.807982 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.808132 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:02.808276 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:02.808961 (+ 685us) server_negotiation.cc:299] Negotiation successful
0812 11:07:02.809069 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":91,"threads_started":1}
I20260812 11:07:02.810228 6723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:02.803406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54302 (local address 127.18.174.195:37239)
0812 11:07:02.804185 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:02.804198 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:02.804219 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:07:02.804296 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:02.804301 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:02.804493 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:02.804650 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:07:02.804801 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.805927 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.807254 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:02.807859 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:02.807976 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:02.808147 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:02.809977 (+ 1830us) server_negotiation.cc:299] Negotiation successful
0812 11:07:02.810080 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":161,"threads_started":1}
I20260812 11:07:02.811856 6067 tablet_service.cc:1467] Processing CreateTablet for tablet 769804d6b8644c5bac47f5e29f6c3376 (DEFAULT_TABLE table=test-table [id=be35e6c02cb2412f8006cad31ed5efd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:07:02.812932 6067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 769804d6b8644c5bac47f5e29f6c3376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:07:02.812665 6568 tablet_service.cc:1467] Processing CreateTablet for tablet 769804d6b8644c5bac47f5e29f6c3376 (DEFAULT_TABLE table=test-table [id=be35e6c02cb2412f8006cad31ed5efd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:07:02.813593 6568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 769804d6b8644c5bac47f5e29f6c3376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:07:02.816140 6312 tablet_service.cc:1467] Processing CreateTablet for tablet 769804d6b8644c5bac47f5e29f6c3376 (DEFAULT_TABLE table=test-table [id=be35e6c02cb2412f8006cad31ed5efd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:07:02.817278 6312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 769804d6b8644c5bac47f5e29f6c3376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:07:02.819732 6728 tablet_bootstrap.cc:492] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628: Bootstrap starting.
I20260812 11:07:02.821635 6730 tablet_bootstrap.cc:492] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469: Bootstrap starting.
I20260812 11:07:02.822168 6728 tablet_bootstrap.cc:654] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628: Neither blocks nor log segments found. Creating new log.
I20260812 11:07:02.822912 6728 log.cc:824] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628: Log is configured to *not* fsync() on all Append() calls
I20260812 11:07:02.824163 6730 tablet_bootstrap.cc:654] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469: Neither blocks nor log segments found. Creating new log.
I20260812 11:07:02.824744 6732 tablet_bootstrap.cc:492] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2: Bootstrap starting.
I20260812 11:07:02.825695 6730 log.cc:824] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469: Log is configured to *not* fsync() on all Append() calls
I20260812 11:07:02.826071 6728 tablet_bootstrap.cc:492] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628: No bootstrap required, opened a new log
I20260812 11:07:02.826282 6728 ts_tablet_manager.cc:1397] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 11:07:02.827492 6730 tablet_bootstrap.cc:492] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469: No bootstrap required, opened a new log
I20260812 11:07:02.827538 6732 tablet_bootstrap.cc:654] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2: Neither blocks nor log segments found. Creating new log.
I20260812 11:07:02.827685 6730 ts_tablet_manager.cc:1397] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260812 11:07:02.828497 6732 log.cc:824] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:07:02.830720 6732 tablet_bootstrap.cc:492] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2: No bootstrap required, opened a new log
I20260812 11:07:02.830924 6732 ts_tablet_manager.cc:1397] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:07:02.830770 6730 raft_consensus.cc:348] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78280045c0364305a15ddd80a3db8db2" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43945 } } peers { permanent_uuid: "45270413f3f64f71adaaa8e15f32a469" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37239 } } peers { permanent_uuid: "807447af09744f9a8d0ec5ee420d4628" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38253 } }
I20260812 11:07:02.830729 6728 raft_consensus.cc:348] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78280045c0364305a15ddd80a3db8db2" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43945 } } peers { permanent_uuid: "45270413f3f64f71adaaa8e15f32a469" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37239 } } peers { permanent_uuid: "807447af09744f9a8d0ec5ee420d4628" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38253 } }
I20260812 11:07:02.831018 6730 raft_consensus.cc:374] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:07:02.831033 6728 raft_consensus.cc:374] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:07:02.831082 6730 raft_consensus.cc:729] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45270413f3f64f71adaaa8e15f32a469, State: Initialized, Role: FOLLOWER
I20260812 11:07:02.831084 6728 raft_consensus.cc:729] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807447af09744f9a8d0ec5ee420d4628, State: Initialized, Role: FOLLOWER
I20260812 11:07:02.831583 6730 consensus_queue.cc:260] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78280045c0364305a15ddd80a3db8db2" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43945 } } peers { permanent_uuid: "45270413f3f64f71adaaa8e15f32a469" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37239 } } peers { permanent_uuid: "807447af09744f9a8d0ec5ee420d4628" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38253 } }
I20260812 11:07:02.832304 6696 heartbeater.cc:503] Master 127.18.174.254:33689 was elected leader, sending a full tablet report...
I20260812 11:07:02.832718 6730 ts_tablet_manager.cc:1428] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260812 11:07:02.832893 6728 consensus_queue.cc:260] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78280045c0364305a15ddd80a3db8db2" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43945 } } peers { permanent_uuid: "45270413f3f64f71adaaa8e15f32a469" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37239 } } peers { permanent_uuid: "807447af09744f9a8d0ec5ee420d4628" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38253 } }
I20260812 11:07:02.833945 6728 ts_tablet_manager.cc:1428] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260812 11:07:02.834328 6182 heartbeater.cc:503] Master 127.18.174.254:33689 was elected leader, sending a full tablet report...
I20260812 11:07:02.834782 6732 raft_consensus.cc:348] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78280045c0364305a15ddd80a3db8db2" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43945 } } peers { permanent_uuid: "45270413f3f64f71adaaa8e15f32a469" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37239 } } peers { permanent_uuid: "807447af09744f9a8d0ec5ee420d4628" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38253 } }
I20260812 11:07:02.834990 6732 raft_consensus.cc:374] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:07:02.835050 6732 raft_consensus.cc:729] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78280045c0364305a15ddd80a3db8db2, State: Initialized, Role: FOLLOWER
I20260812 11:07:02.835421 6732 consensus_queue.cc:260] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78280045c0364305a15ddd80a3db8db2" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43945 } } peers { permanent_uuid: "45270413f3f64f71adaaa8e15f32a469" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37239 } } peers { permanent_uuid: "807447af09744f9a8d0ec5ee420d4628" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38253 } }
I20260812 11:07:02.836071 6427 heartbeater.cc:503] Master 127.18.174.254:33689 was elected leader, sending a full tablet report...
I20260812 11:07:02.836416 6732 ts_tablet_manager.cc:1428] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
W20260812 11:07:03.001674 6697 tablet.cc:2369] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:07:03.017879 6183 tablet.cc:2369] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:07:03.021114 6429 tablet.cc:2369] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:07:03.056293 6736 raft_consensus.cc:482] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:07:03.056529 6736 raft_consensus.cc:504] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78280045c0364305a15ddd80a3db8db2" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43945 } } peers { permanent_uuid: "45270413f3f64f71adaaa8e15f32a469" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37239 } } peers { permanent_uuid: "807447af09744f9a8d0ec5ee420d4628" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38253 } }
I20260812 11:07:03.057731 6736 leader_election.cc:288] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78280045c0364305a15ddd80a3db8db2 (127.18.174.194:43945), 807447af09744f9a8d0ec5ee420d4628 (127.18.174.193:38253)
I20260812 11:07:03.061250 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:03.058101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:48651 (local address 127.18.174.194:43945)
0812 11:07:03.058236 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:03.058240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:03.058257 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:07:03.058381 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:03.058384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:03.058437 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:03.058518 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:07:03.058805 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:03.059300 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:03.060349 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:03.060743 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:03.060857 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:03.060901 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:03.061078 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 11:07:03.061135 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:07:03.061270 6698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:03.058018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:43945 (local address 127.18.174.195:48651)
0812 11:07:03.058127 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:03.058143 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:03.058244 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:03.058554 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:03.058558 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:03.058579 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:07:03.058690 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:03.058696 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:03.059411 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:03.059414 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:03.060228 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:03.060238 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:03.060854 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:03.060858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:03.060963 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:03.060989 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:07:03.061065 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 11:07:03.061132 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 11:07:03.061899 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:03.058018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:38253 (local address 127.18.174.195:56795)
0812 11:07:03.058535 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:03.058547 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:03.058660 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:03.058901 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:03.058903 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:03.058919 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:07:03.059033 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:03.059038 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:03.059732 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:03.059736 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:03.060541 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:03.060551 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:03.061515 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:03.061519 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:03.061606 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:03.061624 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 11:07:03.061694 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 11:07:03.061757 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"mutex_wait_us":143,"thread_start_us":152,"threads_started":1}
I20260812 11:07:03.061915 6722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:03.058231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:56795 (local address 127.18.174.193:38253)
0812 11:07:03.058375 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:03.058380 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:03.058635 (+ 255us) server_negotiation.cc:407] Connection header received
0812 11:07:03.058771 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:03.058773 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:03.058818 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:03.058879 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:07:03.059139 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:03.059630 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:03.060657 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:03.061242 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:03.061370 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:03.061421 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:03.061734 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 11:07:03.061806 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 11:07:03.062000 6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "769804d6b8644c5bac47f5e29f6c3376" candidate_uuid: "45270413f3f64f71adaaa8e15f32a469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78280045c0364305a15ddd80a3db8db2" is_pre_election: true
I20260812 11:07:03.062361 6350 raft_consensus.cc:2454] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45270413f3f64f71adaaa8e15f32a469 in term 0.
I20260812 11:07:03.062615 6090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "769804d6b8644c5bac47f5e29f6c3376" candidate_uuid: "45270413f3f64f71adaaa8e15f32a469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807447af09744f9a8d0ec5ee420d4628" is_pre_election: true
I20260812 11:07:03.062829 6465 leader_election.cc:302] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45270413f3f64f71adaaa8e15f32a469, 78280045c0364305a15ddd80a3db8db2; no voters:
I20260812 11:07:03.062929 6090 raft_consensus.cc:2454] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45270413f3f64f71adaaa8e15f32a469 in term 0.
I20260812 11:07:03.063112 6736 raft_consensus.cc:2781] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:07:03.063212 6736 raft_consensus.cc:482] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:07:03.063266 6736 raft_consensus.cc:3037] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:07:03.064460 6736 raft_consensus.cc:504] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78280045c0364305a15ddd80a3db8db2" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43945 } } peers { permanent_uuid: "45270413f3f64f71adaaa8e15f32a469" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37239 } } peers { permanent_uuid: "807447af09744f9a8d0ec5ee420d4628" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38253 } }
I20260812 11:07:03.064817 6736 leader_election.cc:288] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [CANDIDATE]: Term 1 election: Requested vote from peers 78280045c0364305a15ddd80a3db8db2 (127.18.174.194:43945), 807447af09744f9a8d0ec5ee420d4628 (127.18.174.193:38253)
I20260812 11:07:03.065187 6090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "769804d6b8644c5bac47f5e29f6c3376" candidate_uuid: "45270413f3f64f71adaaa8e15f32a469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807447af09744f9a8d0ec5ee420d4628"
I20260812 11:07:03.065295 6090 raft_consensus.cc:3037] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:07:03.066314 6090 raft_consensus.cc:2454] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45270413f3f64f71adaaa8e15f32a469 in term 1.
I20260812 11:07:03.066584 6350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "769804d6b8644c5bac47f5e29f6c3376" candidate_uuid: "45270413f3f64f71adaaa8e15f32a469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78280045c0364305a15ddd80a3db8db2"
I20260812 11:07:03.066623 6464 leader_election.cc:302] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45270413f3f64f71adaaa8e15f32a469, 807447af09744f9a8d0ec5ee420d4628; no voters:
I20260812 11:07:03.066723 6350 raft_consensus.cc:3037] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:07:03.066792 6736 raft_consensus.cc:2781] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:07:03.067034 6736 raft_consensus.cc:686] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [term 1 LEADER]: Becoming Leader. State: Replica: 45270413f3f64f71adaaa8e15f32a469, State: Running, Role: LEADER
I20260812 11:07:03.067404 6736 consensus_queue.cc:237] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78280045c0364305a15ddd80a3db8db2" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43945 } } peers { permanent_uuid: "45270413f3f64f71adaaa8e15f32a469" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37239 } } peers { permanent_uuid: "807447af09744f9a8d0ec5ee420d4628" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38253 } }
I20260812 11:07:03.067863 6350 raft_consensus.cc:2454] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45270413f3f64f71adaaa8e15f32a469 in term 1.
I20260812 11:07:03.070708 5836 catalog_manager.cc:5495] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45270413f3f64f71adaaa8e15f32a469 (127.18.174.195). New cstate: current_term: 1 leader_uuid: "45270413f3f64f71adaaa8e15f32a469" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78280045c0364305a15ddd80a3db8db2" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45270413f3f64f71adaaa8e15f32a469" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "807447af09744f9a8d0ec5ee420d4628" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38253 } health_report { overall_health: UNKNOWN } } }
I20260812 11:07:03.101193 6723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:03.097879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54304 (local address 127.18.174.195:37239)
0812 11:07:03.098003 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:03.098007 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:03.098021 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:07:03.098153 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:03.098155 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:03.098215 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:03.098301 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:07:03.098503 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:03.098992 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:03.099775 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:03.099977 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:03.100214 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:03.100471 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:07:03.100908 (+ 437us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:07:03.101000 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:03.101028 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 11:07:03.101080 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:07:03.107260 6350 raft_consensus.cc:1261] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2 [term 1 FOLLOWER]: Refusing update from remote peer 45270413f3f64f71adaaa8e15f32a469: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:07:03.107261 6090 raft_consensus.cc:1261] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628 [term 1 FOLLOWER]: Refusing update from remote peer 45270413f3f64f71adaaa8e15f32a469: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:07:03.108009 6736 consensus_queue.cc:1035] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [LEADER]: Connected to new peer: Peer: permanent_uuid: "807447af09744f9a8d0ec5ee420d4628" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:07:03.108223 6741 consensus_queue.cc:1035] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78280045c0364305a15ddd80a3db8db2" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:07:03.117741 6751 mvcc.cc:205] Tried to move back new op lower bound from 7317638443439792128 to 7317638443287023616. Current Snapshot: MvccSnapshot[applied={T|T < 7317638443439792128 or (T in {7317638443439792128})}]
I20260812 11:07:03.118516 6749 mvcc.cc:205] Tried to move back new op lower bound from 7317638443439792128 to 7317638443287023616. Current Snapshot: MvccSnapshot[applied={T|T < 7317638443439792128}]
I20260812 11:07:03.125149 5835 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:07:03.125309 5835 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:07:03.127714 5835 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3f4de2f042db47d6a904021e3d4b0d36: Sending DeleteTablet for 3 replicas of tablet 769804d6b8644c5bac47f5e29f6c3376
I20260812 11:07:03.128659 6312 tablet_service.cc:1514] Processing DeleteTablet for tablet 769804d6b8644c5bac47f5e29f6c3376 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:07:03 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:44010
I20260812 11:07:03.128756 6568 tablet_service.cc:1514] Processing DeleteTablet for tablet 769804d6b8644c5bac47f5e29f6c3376 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:07:03 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:54302
I20260812 11:07:03.128756 6067 tablet_service.cc:1514] Processing DeleteTablet for tablet 769804d6b8644c5bac47f5e29f6c3376 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:07:03 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:35484
I20260812 11:07:03.129305 6771 tablet_replica.cc:330] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628: stopping tablet replica
I20260812 11:07:03.129516 6769 tablet_replica.cc:330] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2: stopping tablet replica
I20260812 11:07:03.129771 6771 raft_consensus.cc:2229] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:07:03.129771 6769 raft_consensus.cc:2229] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:07:03.130107 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 5960
I20260812 11:07:03.130121 6771 raft_consensus.cc:2258] T 769804d6b8644c5bac47f5e29f6c3376 P 807447af09744f9a8d0ec5ee420d4628 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:07:03.130600 6770 tablet_replica.cc:330] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469: stopping tablet replica
I20260812 11:07:03.130937 6770 raft_consensus.cc:2229] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:07:03.131352 6770 raft_consensus.cc:2258] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:07:03.133651 6769 raft_consensus.cc:2258] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:07:03.137537 6769 ts_tablet_manager.cc:1905] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:07:03.140807 6769 ts_tablet_manager.cc:1918] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:07:03.140926 6769 log.cc:1196] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/769804d6b8644c5bac47f5e29f6c3376
I20260812 11:07:03.141244 6769 ts_tablet_manager.cc:1939] T 769804d6b8644c5bac47f5e29f6c3376 P 78280045c0364305a15ddd80a3db8db2: Deleting consensus metadata
I20260812 11:07:03.142756 5814 catalog_manager.cc:4841] TS 78280045c0364305a15ddd80a3db8db2 (127.18.174.194:43945): tablet 769804d6b8644c5bac47f5e29f6c3376 (table test-table [id=be35e6c02cb2412f8006cad31ed5efd2]) successfully deleted
I20260812 11:07:03.143937 6770 ts_tablet_manager.cc:1905] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 11:07:03.146394 5809 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:38253 (error 108)
I20260812 11:07:03.146656 6770 ts_tablet_manager.cc:1918] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:07:03.146760 6770 log.cc:1196] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/769804d6b8644c5bac47f5e29f6c3376
I20260812 11:07:03.147071 6770 ts_tablet_manager.cc:1939] T 769804d6b8644c5bac47f5e29f6c3376 P 45270413f3f64f71adaaa8e15f32a469: Deleting consensus metadata
I20260812 11:07:03.147586 6721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:03.147298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:38253 (local address 127.0.0.1:35498)
0812 11:07:03.147420 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:03.147493 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:38253: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 11:07:03.147614 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 6189
W20260812 11:07:03.147862 5809 catalog_manager.cc:4584] TS 807447af09744f9a8d0ec5ee420d4628 (127.18.174.193:38253): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 769804d6b8644c5bac47f5e29f6c3376: Network error: Client connection negotiation failed: client connection to 127.18.174.193:38253: connect: Connection refused (error 111)
I20260812 11:07:03.167251 5816 catalog_manager.cc:4841] TS 45270413f3f64f71adaaa8e15f32a469 (127.18.174.195:37239): tablet 769804d6b8644c5bac47f5e29f6c3376 (table test-table [id=be35e6c02cb2412f8006cad31ed5efd2]) successfully deleted
I20260812 11:07:03.174417 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 6437
I20260812 11:07:03.199355 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 5773
2026-08-12T11:07:03Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2801 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:07:03 dist-test-slave-lgr5 krb5kdc[6778](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:07:03 dist-test-slave-lgr5 krb5kdc[6778](info): set up 2 sockets
Aug 12 11:07:03 dist-test-slave-lgr5 krb5kdc[6778](info): commencing operation
krb5kdc: starting...
W20260812 11:07:04.410596 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:07:04 dist-test-slave-lgr5 krb5kdc[6778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:07:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:07:04Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.18.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.18.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/rangeradmin_127.18.174.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/rangeradmin_127.18.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.18.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.18.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/rangerlookup_127.18.174.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/rangerlookup_127.18.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.18.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/HTTP_127.18.174.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/HTTP_127.18.174.212@KRBTEST.COM.keytab.
I20260812 11:07:04.591084 19131 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskuq4X_z/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/postgres -l logfile start
2026-08-12 11:07:07.115 UTC [6829] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 11:07:07.115 UTC [6829] LOG: listening on IPv4 address "127.18.174.212", port 51053
2026-08-12 11:07:07.119 UTC [6829] LOG: listening on Unix socket "/tmp/.s.PGSQL.51053"
2026-08-12 11:07:07.147 UTC [6834] LOG: database system was shut down at 2026-08-12 11:07:05 UTC
2026-08-12 11:07:07.151 UTC [6829] LOG: database system is ready to accept connections
I20260812 11:07:08.259256 19131 mini_postgres.cc:96] Postgres bound to 51053
2026-08-12 11:07:08.268 UTC [6847] FATAL: database "slave" does not exist
127.18.174.212:51053 - accepting connections
I20260812 11:07:08.269311 19131 mini_ranger.cc:161] Starting Ranger...
I20260812 11:07:08.287122 19131 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 11:07:08.785130 19131 mini_ranger.cc:87] Created ranger Postgres database
I20260812 11:07:08.785224 19131 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-admin
2026-08-12 11:07:09,155 [I] DB FLAVOR :POSTGRES
2026-08-12 11:07:09,156 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:07:09,156 [I] Checking connection..
2026-08-12 11:07:09,156 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 11:07:09,416 [I] Checking connection passed.
2026-08-12 11:07:09,416 [I] --------- Verifying version history table ---------
2026-08-12 11:07:09,416 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:07:09,683 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:07:09,683 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:07:09,935 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:07:09,935 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 11:07:09,935 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 11:07:10.182 UTC [6965] WARNING: there is no transaction in progress
2026-08-12 11:07:10,192 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 11:07:10,192 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:07:10,453 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 11:07:10,453 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:07:10,453 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 11:07:10,719 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 11:07:10,957 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-lgr5.c.gcp-upstream.internal','N') ;"
2026-08-12 11:07:11,215 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:07:11,471 [I] Table x_portal_user does not exist in database ranger
2026-08-12 11:07:11,472 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:07:11,738 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 11:07:11,739 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:07:12,014 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:07:12,275 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 11:07:12,276 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 11:07:13.281 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:13.298 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:13.317 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:13.333 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:13.348 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:13.367 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:13.434 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:13.441 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:13.456 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:13.466 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:13.477 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:13.492 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:13.502 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:13.509 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:13.515 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:13.522 UTC [7147] WARNING: there is no transaction in progress
2026-08-12 11:07:14,207 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 11:07:14,208 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 11:07:14,472 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 11:07:14,473 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:07:14,747 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 11:07:14,747 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:07:15,019 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 11:07:15,020 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:07:15,279 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:07:15,547 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-lgr5.c.gcp-upstream.internal';"
2026-08-12 11:07:15,790 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 11:07:15,790 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 11:07:16,065 [I] DB_PATCHES have already been applied
I20260812 11:07:16.071983 19131 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-admin:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskuq4X_z/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 11:07:16.072072 19131 mini_ranger.cc:193] Using host: 127.18.174.212
I20260812 11:07:16.076838 19131 mini_ranger.cc:227] Ranger admin URL: http://127.18.174.212:43019
Aug 12, 2026 11:07:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:07:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:07:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 11:07:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 11:07:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 11:07:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 11:07:17 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 11:07:17.341094 19131 mini_ranger.cc:160] Time spent starting Ranger: real 9.072s user 0.002s sys 0.010s
Aug 12, 2026 11:07:38 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 11:07:38 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 12, 2026 11:07:38 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 11:07:38 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 11:07:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 11:07:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 11:07:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 11:07:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 11:07:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 11:07:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 11:07:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 11:07:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 11:07:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 11:07:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 11:07:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 11:07:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 11:07:38 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 11:07:39 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 11:07:40.154317 19131 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.18.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.18.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/rangerkms_127.18.174.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/rangerkms_127.18.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.174.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.18.174.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.174.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/HTTP_127.18.174.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.174.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/HTTP_127.18.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 11:07:40 dist-test-slave-lgr5 krb5kdc[6778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532860, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 11:07:40.258661 19131 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 11:07:40.269932 19131 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 11:07:41.310424 19131 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 11:07:41.310521 19131 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-kms
I20260812 11:07:41.310601 19131 mini_ranger_kms.cc:227] Using postgres at 127.18.174.212:51053
2026-08-12 11:07:41,540 [I] DB FLAVOR :POSTGRES
2026-08-12 11:07:41,540 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:07:41,540 [I] Checking connection
2026-08-12 11:07:41,540 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 11:07:41,814 [I] connection success
2026-08-12 11:07:41,814 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 11:07:41,814 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 11:07:41,814 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 11:07:42,091 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 11:07:42,091 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:07:42,092 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 11:07:42,092 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:51053/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 11:07:42,389 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 11:07:42.990248 19131 mini_ranger_kms.cc:310] Created kms service
I20260812 11:07:43.195314 19131 mini_ranger_kms.cc:326] Created kudu user
I20260812 11:07:43.242267 19131 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 11:07:43 dist-test-slave-lgr5 krb5kdc[6778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532860, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:07:43.673785 19131 mini_ranger_kms.cc:384] Added ranger policy
I20260812 11:07:43.673982 19131 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-kms:/tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 11:07:43.674018 19131 mini_ranger_kms.cc:240] Using host: 127.18.174.212
I20260812 11:07:43.679287 19131 mini_ranger_kms.cc:276] Ranger KMS PID: 7463
I20260812 11:07:43.679432 19131 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.18.174.212:35919
Aug 12, 2026 11:07:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:07:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:07:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 11:07:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 11:07:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 11:07:45 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 11:07:45 dist-test-slave-lgr5 krb5kdc[6778](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786532865, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.174.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:07:46.250810 19131 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.992s user 0.011s sys 0.204s
I20260812 11:07:46.250955 19131 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 11:07:46.251116 19131 mini_ranger_kms.cc:401] 127.18.174.212:35919/kms/v1/keys
Aug 12 11:07:46 dist-test-slave-lgr5 krb5kdc[6778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532865, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.174.212@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
Aug 12 11:07:46 dist-test-slave-lgr5 krb5kdc[6778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532865, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.174.212@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
Aug 12 11:07:49 dist-test-slave-lgr5 krb5kdc[6778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:07:49.276921 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45889
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:36651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:45889
--ranger_config_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.174.212:35919/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:07:49.423559 7566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:07:49.423868 7566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:07:49.423909 7566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:07:49.428045 7566 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:07:49.428169 7566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:07:49.428193 7566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:07:49.428226 7566 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:07:49.428254 7566 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:07:49.434083 7566 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/wal
--ranger_kms_url=127.18.174.212:35919/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:45889
--ranger_config_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:07:49.435336 7566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:07:49.436712 7566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:07:49.446936 7579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:07:49.447036 7574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:49.447073 7566 server_base.cc:1034] running on GCE node
W20260812 11:07:49.447342 7575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:49.447975 7566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:07:49.449285 7566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:07:49.450469 7566 hybrid_clock.cc:648] HybridClock initialized: now 1786532869450430 us; error 56 us; skew 500 ppm
Aug 12 11:07:49 dist-test-slave-lgr5 krb5kdc[6778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532869, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:07:49.453446 7566 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:07:49.454487 7566 webserver.cc:460] Webserver started at http://127.18.174.254:43985/ using document root <none> and password file <none>
I20260812 11:07:49.455087 7566 fs_manager.cc:359] Metadata directory not provided
I20260812 11:07:49.455149 7566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:07:49.455370 7566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:07:49 dist-test-slave-lgr5 krb5kdc[6778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532869, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:07:49.507293 7566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "061df93495494bd8865b3a0601b6c167"
format_stamp: "Formatted at 2026-08-12 11:07:49 on dist-test-slave-lgr5"
server_key: "11c259c895f0d2ec627f410feae7ccb2"
server_key_iv: "62d0d8b343a61b6b42aa3d494d311794"
server_key_version: "kuduclusterkey@0"
I20260812 11:07:49.507997 7566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "061df93495494bd8865b3a0601b6c167"
format_stamp: "Formatted at 2026-08-12 11:07:49 on dist-test-slave-lgr5"
server_key: "11c259c895f0d2ec627f410feae7ccb2"
server_key_iv: "62d0d8b343a61b6b42aa3d494d311794"
server_key_version: "kuduclusterkey@0"
I20260812 11:07:49.512205 7566 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:07:49.527446 7590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:49.528885 7566 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:07:49.529016 7566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "061df93495494bd8865b3a0601b6c167"
format_stamp: "Formatted at 2026-08-12 11:07:49 on dist-test-slave-lgr5"
server_key: "11c259c895f0d2ec627f410feae7ccb2"
server_key_iv: "62d0d8b343a61b6b42aa3d494d311794"
server_key_version: "kuduclusterkey@0"
I20260812 11:07:49.529165 7566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:07:49.542465 7566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:07:49.545971 7566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:07:49.546180 7566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:07:49.555086 7566 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:45889
I20260812 11:07:49.555112 7684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:45889 every 8 connection(s)
I20260812 11:07:49.556193 7566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:07:49.557562 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 7566
I20260812 11:07:49.557698 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:07:49.558007 19131 external_mini_cluster.cc:1428] Setting key 3be873e2bfdaf8c648556b25c0cde698
I20260812 11:07:49.559890 7685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:07:49.566787 7685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167: Bootstrap starting.
Aug 12 11:07:49 dist-test-slave-lgr5 krb5kdc[6778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:07:49.569602 7685 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167: Neither blocks nor log segments found. Creating new log.
I20260812 11:07:49.570632 7685 log.cc:824] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167: Log is configured to *not* fsync() on all Append() calls
I20260812 11:07:49.573342 7685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167: No bootstrap required, opened a new log
I20260812 11:07:49.576030 7693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:49.559537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48246 (local address 127.18.174.254:45889)
0812 11:07:49.560043 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:49.560064 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:49.560134 (+ 70us) server_negotiation.cc:407] Connection header received
0812 11:07:49.561021 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:49.561046 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:49.561499 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:49.561873 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:07:49.562814 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:49.564358 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:49.565632 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:49.566418 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:49.566603 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:49.569744 (+ 3141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:07:49.569752 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:07:49.569771 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:07:49.569821 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:07:49.572502 (+ 2681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:49.573084 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:49.573091 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:49.573098 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:49.573258 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:49.573611 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:49.573614 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:49.573616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:49.574189 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:07:49.574407 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:49.574709 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 11:07:49.575026 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":161,"threads_started":1}
I20260812 11:07:49.577527 7685 raft_consensus.cc:348] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061df93495494bd8865b3a0601b6c167" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45889 } }
I20260812 11:07:49.577782 7685 raft_consensus.cc:374] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:07:49.577872 7685 raft_consensus.cc:729] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 061df93495494bd8865b3a0601b6c167, State: Initialized, Role: FOLLOWER
I20260812 11:07:49.578356 7685 consensus_queue.cc:260] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061df93495494bd8865b3a0601b6c167" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45889 } }
I20260812 11:07:49.578501 7685 raft_consensus.cc:388] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:07:49.578584 7685 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:07:49.578696 7685 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:07:49.579831 7685 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061df93495494bd8865b3a0601b6c167" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45889 } }
I20260812 11:07:49.580288 7685 leader_election.cc:302] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 061df93495494bd8865b3a0601b6c167; no voters:
I20260812 11:07:49.580878 7685 leader_election.cc:288] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:07:49.580982 7695 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:07:49.581306 7695 raft_consensus.cc:686] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [term 1 LEADER]: Becoming Leader. State: Replica: 061df93495494bd8865b3a0601b6c167, State: Running, Role: LEADER
I20260812 11:07:49.581751 7695 consensus_queue.cc:237] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061df93495494bd8865b3a0601b6c167" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45889 } }
I20260812 11:07:49.582507 7685 sys_catalog.cc:564] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:07:49.583693 7697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "061df93495494bd8865b3a0601b6c167" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061df93495494bd8865b3a0601b6c167" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45889 } } }
I20260812 11:07:49.583843 7697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [sys.catalog]: This master's current role is: LEADER
I20260812 11:07:49.584252 7696 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 061df93495494bd8865b3a0601b6c167. Latest consensus state: current_term: 1 leader_uuid: "061df93495494bd8865b3a0601b6c167" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "061df93495494bd8865b3a0601b6c167" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45889 } } }
I20260812 11:07:49.584318 7709 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:07:49.584359 7696 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167 [sys.catalog]: This master's current role is: LEADER
I20260812 11:07:49.587891 7709 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:07:49.588819 7685 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 11:07:49.600258 7709 catalog_manager.cc:1347] Generated new cluster ID: 6e77192cbb774ff4bffde4b48edb51d8
I20260812 11:07:49.600456 7709 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:07:49.648895 7709 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:07:49.649959 7709 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:07:49.659794 7709 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167: Generated new TSK 0
I20260812 11:07:49.660739 7709 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:07:50.336138 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.174.212:35919/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45889
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:36651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:07:50.466326 7762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:07:50.466652 7762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:07:50.466699 7762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:07:50.471180 7762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:07:50.471274 7762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:07:50.471345 7762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:07:50.477710 7762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.18.174.212:35919/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45889
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7762
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:07:50.478991 7762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:07:50.480293 7762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:07:50.492791 7770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:07:50.494663 7767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:50.495240 7762 server_base.cc:1034] running on GCE node
W20260812 11:07:50.496744 7773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:50.497431 7762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:07:50.498452 7762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:07:50.501911 7762 hybrid_clock.cc:648] HybridClock initialized: now 1786532870501854 us; error 63 us; skew 500 ppm
Aug 12 11:07:50 dist-test-slave-lgr5 krb5kdc[6778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532870, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:07:50.506090 7762 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:07:50.507740 7762 webserver.cc:460] Webserver started at http://127.18.174.193:45489/ using document root <none> and password file <none>
I20260812 11:07:50.508682 7762 fs_manager.cc:359] Metadata directory not provided
I20260812 11:07:50.508826 7762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:07:50.509238 7762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:07:50 dist-test-slave-lgr5 krb5kdc[6778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532870, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:07:50.527281 7762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "51dd33915290417e975346495bbb162a"
format_stamp: "Formatted at 2026-08-12 11:07:50 on dist-test-slave-lgr5"
server_key: "258796abaaf42c1683527321491e5988"
server_key_iv: "945cdd1b1d5e8d612565fe58650c088e"
server_key_version: "kuduclusterkey@0"
I20260812 11:07:50.528002 7762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "51dd33915290417e975346495bbb162a"
format_stamp: "Formatted at 2026-08-12 11:07:50 on dist-test-slave-lgr5"
server_key: "258796abaaf42c1683527321491e5988"
server_key_iv: "945cdd1b1d5e8d612565fe58650c088e"
server_key_version: "kuduclusterkey@0"
I20260812 11:07:50.533520 7762 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 11:07:50.555363 7786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:50.557458 7762 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:07:50.557639 7762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "51dd33915290417e975346495bbb162a"
format_stamp: "Formatted at 2026-08-12 11:07:50 on dist-test-slave-lgr5"
server_key: "258796abaaf42c1683527321491e5988"
server_key_iv: "945cdd1b1d5e8d612565fe58650c088e"
server_key_version: "kuduclusterkey@0"
I20260812 11:07:50.557785 7762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:07:50.579933 7762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:07:50.584519 7762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:07:50.584802 7762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:07:50.585636 7762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:07:50.586899 7762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:07:50.587044 7762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:50.587173 7762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:07:50.587255 7762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:50.602262 7762 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:42483
I20260812 11:07:50.603775 7762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:07:50.605576 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 7762
I20260812 11:07:50.605721 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:07:50.605978 7981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:42483 every 8 connection(s)
I20260812 11:07:50.606065 19131 external_mini_cluster.cc:1428] Setting key 0fadbc8180de063ca978590b633473a2
Aug 12 11:07:50 dist-test-slave-lgr5 krb5kdc[6778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532870, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
I20260812 11:07:50.628928 7985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:50.608286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:40139 (local address 127.18.174.254:45889)
0812 11:07:50.613369 (+ 5083us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:50.613379 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:50.614941 (+ 1562us) server_negotiation.cc:407] Connection header received
0812 11:07:50.615032 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:50.615036 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:50.615099 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:50.615192 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:07:50.617010 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:50.617876 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:50.619839 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:50.620244 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:50.620365 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:50.623703 (+ 3338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:07:50.623709 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:07:50.623711 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:07:50.623749 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:07:50.625750 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:50.626586 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:50.626589 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:50.626591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:50.626694 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:50.627226 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:50.627230 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:50.627232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:50.627504 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:07:50.627616 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:50.628564 (+ 948us) server_negotiation.cc:299] Negotiation successful
0812 11:07:50.628722 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4986,"thread_start_us":136,"threads_started":1}
I20260812 11:07:50.630339 7987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:50.609014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45889 (local address 127.18.174.193:40139)
0812 11:07:50.613292 (+ 4278us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:50.613375 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:50.614559 (+ 1184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:50.615572 (+ 1013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:50.615583 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:50.616002 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:07:50.616791 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:50.616815 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:50.618117 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:50.618121 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:50.619661 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:50.619677 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:50.620452 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:50.620456 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:50.620704 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:50.621463 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:07:50.621488 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:07:50.623424 (+ 1936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:07:50.625932 (+ 2508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:07:50.625942 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:07:50.625967 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:07:50.626413 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:07:50.626830 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:07:50.626834 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:07:50.626836 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:07:50.627088 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:07:50.627706 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:07:50.627716 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:07:50.628195 (+ 479us) client_negotiation.cc:769] Sending connection context
0812 11:07:50.628453 (+ 258us) client_negotiation.cc:240] Negotiation successful
0812 11:07:50.628884 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3967,"thread_start_us":132,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
I20260812 11:07:50.632428 7983 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45889
I20260812 11:07:50.632704 7983 heartbeater.cc:464] Registering TS with master...
I20260812 11:07:50.633368 7983 heartbeater.cc:511] Master 127.18.174.254:45889 requested a full tablet report, sending...
I20260812 11:07:50.635447 7619 ts_manager.cc:194] Registered new tserver with Master: 51dd33915290417e975346495bbb162a (127.18.174.193:42483)
I20260812 11:07:50.637208 7619 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:40139
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:07:50.660187 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.174.212:35919/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45889
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:36651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:07:50 dist-test-slave-lgr5 krb5kdc[6778](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786532870, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 11:07:50.835690 7993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:07:50.836306 7993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:07:50.836405 7993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:07:50.842952 7993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:07:50.843075 7993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:07:50.843170 7993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:07:50.851830 7993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.18.174.212:35919/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45889
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:07:50.853420 7993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:07:50.854911 7993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:07:50.870020 8004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:07:50.870034 8005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:07:50.870450 8007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:50.871088 7993 server_base.cc:1034] running on GCE node
I20260812 11:07:50.871658 7993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:07:50.872628 7993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:07:50.873834 7993 hybrid_clock.cc:648] HybridClock initialized: now 1786532870873796 us; error 57 us; skew 500 ppm
Aug 12 11:07:50 dist-test-slave-lgr5 krb5kdc[6778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532870, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:07:50.877916 7993 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:07:50.879318 7993 webserver.cc:460] Webserver started at http://127.18.174.194:37917/ using document root <none> and password file <none>
I20260812 11:07:50.880220 7993 fs_manager.cc:359] Metadata directory not provided
I20260812 11:07:50.880331 7993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:07:50.880631 7993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:07:50 dist-test-slave-lgr5 krb5kdc[6778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532870, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:07:50.897811 7993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "d2c4de1b019649b99bd7433ce71b9afd"
format_stamp: "Formatted at 2026-08-12 11:07:50 on dist-test-slave-lgr5"
server_key: "914f54ee05215fc5c619ff8bc749f2dc"
server_key_iv: "7ea73d87fbc2ca3204b6fc75cf08b95b"
server_key_version: "kuduclusterkey@0"
I20260812 11:07:50.898685 7993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "d2c4de1b019649b99bd7433ce71b9afd"
format_stamp: "Formatted at 2026-08-12 11:07:50 on dist-test-slave-lgr5"
server_key: "914f54ee05215fc5c619ff8bc749f2dc"
server_key_iv: "7ea73d87fbc2ca3204b6fc75cf08b95b"
server_key_version: "kuduclusterkey@0"
I20260812 11:07:50.905222 7993 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:07:50.929993 8016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:50.931957 7993 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260812 11:07:50.932158 7993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "d2c4de1b019649b99bd7433ce71b9afd"
format_stamp: "Formatted at 2026-08-12 11:07:50 on dist-test-slave-lgr5"
server_key: "914f54ee05215fc5c619ff8bc749f2dc"
server_key_iv: "7ea73d87fbc2ca3204b6fc75cf08b95b"
server_key_version: "kuduclusterkey@0"
I20260812 11:07:50.932360 7993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:07:50.967064 7993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:07:50.971089 7993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:07:50.971305 7993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:07:50.972134 7993 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:07:50.973304 7993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:07:50.973371 7993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:50.973425 7993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:07:50.973452 7993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:50.985394 7993 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:39597
I20260812 11:07:50.985452 8213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:39597 every 8 connection(s)
I20260812 11:07:50.986816 7993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:07:50.994022 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 7993
I20260812 11:07:50.994163 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:07:50.994450 19131 external_mini_cluster.cc:1428] Setting key bb657ec42f0b75efec33d5a1ed63d8f6
Aug 12 11:07:51 dist-test-slave-lgr5 krb5kdc[6778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532870, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:07:51.011274 7985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:50.991561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:41911 (local address 127.18.174.254:45889)
0812 11:07:50.991694 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:50.991698 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:50.995532 (+ 3834us) server_negotiation.cc:407] Connection header received
0812 11:07:50.997043 (+ 1511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:50.997048 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:50.997111 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:50.997176 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:07:50.999288 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.000070 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.002119 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.002492 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.002589 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.006195 (+ 3606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:07:51.006200 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:07:51.006203 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:07:51.006241 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:07:51.008217 (+ 1976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:51.009065 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:51.009069 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:51.009071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:51.009179 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:51.009698 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:51.009702 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:51.009703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:51.009973 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:07:51.010055 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:51.010916 (+ 861us) server_negotiation.cc:299] Negotiation successful
0812 11:07:51.011092 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:07:51.013597 8221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:50.990333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45889 (local address 127.18.174.194:41911)
0812 11:07:50.992030 (+ 1697us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:50.995388 (+ 3358us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:50.996735 (+ 1347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:50.997704 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:50.997716 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:50.998154 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:07:50.999080 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:50.999106 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.000298 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.000301 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:51.001914 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:51.001933 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.002851 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.002855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:51.003104 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.003911 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:07:51.003937 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:07:51.005904 (+ 1967us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:07:51.008435 (+ 2531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:07:51.008443 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:07:51.008467 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:07:51.008920 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:07:51.009310 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:07:51.009313 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:07:51.009315 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:07:51.009569 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:07:51.010149 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:07:51.010157 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:07:51.010583 (+ 426us) client_negotiation.cc:769] Sending connection context
0812 11:07:51.011840 (+ 1257us) client_negotiation.cc:240] Negotiation successful
0812 11:07:51.012331 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1449,"thread_start_us":173,"threads_started":1}
I20260812 11:07:51.017920 8216 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45889
I20260812 11:07:51.018250 8216 heartbeater.cc:464] Registering TS with master...
I20260812 11:07:51.019006 8216 heartbeater.cc:511] Master 127.18.174.254:45889 requested a full tablet report, sending...
I20260812 11:07:51.020576 7619 ts_manager.cc:194] Registered new tserver with Master: d2c4de1b019649b99bd7433ce71b9afd (127.18.174.194:39597)
I20260812 11:07:51.021399 7619 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:41911
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:07:51.073370 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.174.212:35919/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45889
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:36651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:07:51 dist-test-slave-lgr5 krb5kdc[6778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532870, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
W20260812 11:07:51.300943 8224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:07:51.302101 8224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:07:51.302245 8224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:07:51.309363 8224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:07:51.309762 8224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:07:51.309947 8224 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:07:51.319041 8224 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.18.174.212:35919/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45889
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:07:51.321108 8224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:07:51.322999 8224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:07:51.339143 8242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:07:51.339628 8240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:51.341102 8224 server_base.cc:1034] running on GCE node
W20260812 11:07:51.348373 8246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:07:51.349182 8224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:07:51.350258 8224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:07:51.365834 8224 hybrid_clock.cc:648] HybridClock initialized: now 1786532871365633 us; error 212 us; skew 500 ppm
Aug 12 11:07:51 dist-test-slave-lgr5 krb5kdc[6778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532871, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:07:51.370951 8224 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:07:51.372479 8224 webserver.cc:460] Webserver started at http://127.18.174.195:40479/ using document root <none> and password file <none>
I20260812 11:07:51.373404 8224 fs_manager.cc:359] Metadata directory not provided
I20260812 11:07:51.373594 8224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:07:51.373919 8224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:07:51 dist-test-slave-lgr5 krb5kdc[6778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532871, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:07:51.406574 8224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "aae783a6f5cf4f1ebb771361053fc57d"
format_stamp: "Formatted at 2026-08-12 11:07:51 on dist-test-slave-lgr5"
server_key: "5ff0904f657a93ff705db066af530c0a"
server_key_iv: "9b766a0c4841689186004572f00458e8"
server_key_version: "kuduclusterkey@0"
I20260812 11:07:51.420779 8224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "aae783a6f5cf4f1ebb771361053fc57d"
format_stamp: "Formatted at 2026-08-12 11:07:51 on dist-test-slave-lgr5"
server_key: "5ff0904f657a93ff705db066af530c0a"
server_key_iv: "9b766a0c4841689186004572f00458e8"
server_key_version: "kuduclusterkey@0"
I20260812 11:07:51.433225 8224 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.005s sys 0.001s
I20260812 11:07:51.460682 8259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:51.462790 8224 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.004s sys 0.000s
I20260812 11:07:51.462996 8224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "aae783a6f5cf4f1ebb771361053fc57d"
format_stamp: "Formatted at 2026-08-12 11:07:51 on dist-test-slave-lgr5"
server_key: "5ff0904f657a93ff705db066af530c0a"
server_key_iv: "9b766a0c4841689186004572f00458e8"
server_key_version: "kuduclusterkey@0"
I20260812 11:07:51.463191 8224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:07:51.481614 8224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:07:51.485848 8224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:07:51.486186 8224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:07:51.487144 8224 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:07:51.488406 8224 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:07:51.488476 8224 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:51.488535 8224 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:07:51.488565 8224 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:07:51.501529 8224 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:36535
I20260812 11:07:51.501761 8465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:36535 every 8 connection(s)
I20260812 11:07:51.502967 8224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:07:51.504418 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 8224
I20260812 11:07:51.504558 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:07:51.504892 19131 external_mini_cluster.cc:1428] Setting key 75daba654f50b9d55a779a4c85792620
Aug 12 11:07:51 dist-test-slave-lgr5 krb5kdc[6778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532871, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:07:51.521695 7985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:51.507639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:52129 (local address 127.18.174.254:45889)
0812 11:07:51.507828 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:51.507833 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:51.507848 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:07:51.508682 (+ 834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:51.508685 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:51.508741 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:51.508817 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:07:51.510557 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.511102 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.512941 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.513325 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.513463 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.516819 (+ 3356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:07:51.516823 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:07:51.516826 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:07:51.516862 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:07:51.518689 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:51.519484 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:51.519488 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:51.519490 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:51.519629 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:51.520177 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:51.520181 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:51.520183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:51.520447 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:07:51.520540 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:51.521369 (+ 829us) server_negotiation.cc:299] Negotiation successful
0812 11:07:51.521524 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260812 11:07:51.523670 8470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:51.506089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45889 (local address 127.18.174.195:52129)
0812 11:07:51.506824 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:51.506900 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:51.508441 (+ 1541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:51.509044 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:51.509055 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:51.509562 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:07:51.510356 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:51.510382 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.511246 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.511250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:51.512768 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:51.512784 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.513547 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.513552 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:51.513795 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.514601 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:07:51.514627 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:07:51.516564 (+ 1937us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:07:51.518871 (+ 2307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:07:51.518881 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:07:51.518905 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:07:51.519333 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:07:51.519759 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:07:51.519763 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:07:51.519765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:07:51.520015 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:07:51.520623 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:07:51.520630 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:07:51.521047 (+ 417us) client_negotiation.cc:769] Sending connection context
0812 11:07:51.521890 (+ 843us) client_negotiation.cc:240] Negotiation successful
0812 11:07:51.522320 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":210,"threads_started":1}
I20260812 11:07:51.526350 8468 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45889
I20260812 11:07:51.526703 8468 heartbeater.cc:464] Registering TS with master...
I20260812 11:07:51.527472 8468 heartbeater.cc:511] Master 127.18.174.254:45889 requested a full tablet report, sending...
I20260812 11:07:51.528923 7619 ts_manager.cc:194] Registered new tserver with Master: aae783a6f5cf4f1ebb771361053fc57d (127.18.174.195:36535)
I20260812 11:07:51.529742 7619 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:52129
I20260812 11:07:51.534354 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:07:51.551128 7985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:51.540518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44148 (local address 127.18.174.254:45889)
0812 11:07:51.540679 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:51.540684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:51.541149 (+ 465us) server_negotiation.cc:407] Connection header received
0812 11:07:51.541299 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:51.541302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:51.541360 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:51.541520 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:07:51.542589 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.543409 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.544632 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.544974 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.545097 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.547037 (+ 1940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:07:51.547042 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:07:51.547045 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:07:51.547083 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:07:51.549013 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:51.549649 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:51.549653 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:51.549655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:51.549765 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:07:51.550090 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:07:51.550093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:07:51.550095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:07:51.550354 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:07:51.550494 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:51.550817 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 11:07:51.550959 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:07:51.557192 7619 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44148:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:07:51.561484 7619 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:07:51.586179 8502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:51.574322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:42483 (local address 127.0.0.1:48616)
0812 11:07:51.575216 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:51.575295 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:51.575458 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:51.579563 (+ 4105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:51.579571 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:51.579602 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:07:51.579806 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:51.579815 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.581431 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.581435 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:51.582863 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:51.582878 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.585468 (+ 2590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.585472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:51.585682 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.585735 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 11:07:51.585849 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 11:07:51.586011 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":705,"mutex_wait_us":31,"thread_start_us":109,"threads_started":1}
I20260812 11:07:51.586982 8494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:51.572651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:36535 (local address 127.0.0.1:33290)
0812 11:07:51.578440 (+ 5789us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:51.578457 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:51.578585 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:51.580781 (+ 2196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:51.580786 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:51.580813 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:07:51.580973 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:51.580982 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.582705 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.582709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:51.584129 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:51.584145 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.585457 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.585463 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:51.586646 (+ 1183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.586672 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:07:51.586753 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 11:07:51.586834 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1401,"mutex_wait_us":982,"thread_start_us":133,"threads_started":1}
I20260812 11:07:51.587356 8495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:51.572783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33290 (local address 127.18.174.195:36535)
0812 11:07:51.573963 (+ 1180us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:51.573977 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:51.580165 (+ 6188us) server_negotiation.cc:407] Connection header received
0812 11:07:51.580267 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:51.580273 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:51.580520 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:51.580696 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:07:51.581165 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.582470 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.584360 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.585284 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.585663 (+ 379us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.585859 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:51.586843 (+ 984us) server_negotiation.cc:299] Negotiation successful
0812 11:07:51.586981 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1055,"thread_start_us":160,"threads_started":1}
I20260812 11:07:51.588040 8498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:51.574566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48616 (local address 127.18.174.193:42483)
0812 11:07:51.578883 (+ 4317us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:51.578891 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:51.578919 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:07:51.579012 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:51.579019 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:51.579348 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:51.580009 (+ 661us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:07:51.580217 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.581310 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.583051 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.583967 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.587549 (+ 3582us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.587722 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:51.587779 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 11:07:51.587883 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4176,"thread_start_us":104,"threads_started":1}
I20260812 11:07:51.591055 7861 tablet_service.cc:1467] Processing CreateTablet for tablet eeecd974c8c34a6dbd391f0629e22384 (DEFAULT_TABLE table=test-table [id=8131786d7b6c4424b4195873a33f9815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:07:51.591066 8342 tablet_service.cc:1467] Processing CreateTablet for tablet eeecd974c8c34a6dbd391f0629e22384 (DEFAULT_TABLE table=test-table [id=8131786d7b6c4424b4195873a33f9815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:07:51.592406 7861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeecd974c8c34a6dbd391f0629e22384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:07:51.592404 8342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeecd974c8c34a6dbd391f0629e22384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:07:51.602280 8505 tablet_bootstrap.cc:492] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d: Bootstrap starting.
I20260812 11:07:51.604305 8507 tablet_bootstrap.cc:492] T eeecd974c8c34a6dbd391f0629e22384 P 51dd33915290417e975346495bbb162a: Bootstrap starting.
I20260812 11:07:51.604626 8496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:51.574322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:39597 (local address 127.0.0.1:38156)
0812 11:07:51.584284 (+ 9962us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:51.584300 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:51.584402 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:51.587254 (+ 2852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:51.587257 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:51.587296 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:07:51.587395 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:51.587402 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.600928 (+ 13526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.600932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:51.602361 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:51.602379 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.603638 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.603644 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:51.603763 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.603801 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 11:07:51.603904 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 11:07:51.604004 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9860,"mutex_wait_us":493,"thread_start_us":88,"threads_started":1}
I20260812 11:07:51.604912 8497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:51.574558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38156 (local address 127.18.174.194:39597)
0812 11:07:51.584685 (+ 10127us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:51.584693 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:51.584721 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:07:51.584817 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:51.584824 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:51.585082 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:51.585247 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:07:51.599571 (+ 14324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.600757 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.602560 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.603445 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.603613 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.603781 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:51.604196 (+ 415us) server_negotiation.cc:299] Negotiation successful
0812 11:07:51.604325 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9991,"thread_start_us":112,"threads_started":1}
I20260812 11:07:51.607085 8507 tablet_bootstrap.cc:654] T eeecd974c8c34a6dbd391f0629e22384 P 51dd33915290417e975346495bbb162a: Neither blocks nor log segments found. Creating new log.
I20260812 11:07:51.608002 8507 log.cc:824] T eeecd974c8c34a6dbd391f0629e22384 P 51dd33915290417e975346495bbb162a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:07:51.608837 8105 tablet_service.cc:1467] Processing CreateTablet for tablet eeecd974c8c34a6dbd391f0629e22384 (DEFAULT_TABLE table=test-table [id=8131786d7b6c4424b4195873a33f9815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:07:51.610311 8105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeecd974c8c34a6dbd391f0629e22384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:07:51.611456 8505 tablet_bootstrap.cc:654] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d: Neither blocks nor log segments found. Creating new log.
I20260812 11:07:51.612498 8505 log.cc:824] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:07:51.615252 8507 tablet_bootstrap.cc:492] T eeecd974c8c34a6dbd391f0629e22384 P 51dd33915290417e975346495bbb162a: No bootstrap required, opened a new log
I20260812 11:07:51.615522 8507 ts_tablet_manager.cc:1397] T eeecd974c8c34a6dbd391f0629e22384 P 51dd33915290417e975346495bbb162a: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260812 11:07:51.619779 8507 raft_consensus.cc:348] T eeecd974c8c34a6dbd391f0629e22384 P 51dd33915290417e975346495bbb162a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae783a6f5cf4f1ebb771361053fc57d" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36535 } } peers { permanent_uuid: "51dd33915290417e975346495bbb162a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 42483 } } peers { permanent_uuid: "d2c4de1b019649b99bd7433ce71b9afd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39597 } }
I20260812 11:07:51.620194 8507 raft_consensus.cc:374] T eeecd974c8c34a6dbd391f0629e22384 P 51dd33915290417e975346495bbb162a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:07:51.620273 8507 raft_consensus.cc:729] T eeecd974c8c34a6dbd391f0629e22384 P 51dd33915290417e975346495bbb162a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51dd33915290417e975346495bbb162a, State: Initialized, Role: FOLLOWER
I20260812 11:07:51.622087 8505 tablet_bootstrap.cc:492] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d: No bootstrap required, opened a new log
I20260812 11:07:51.622459 8505 ts_tablet_manager.cc:1397] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.000s
I20260812 11:07:51.623164 8507 consensus_queue.cc:260] T eeecd974c8c34a6dbd391f0629e22384 P 51dd33915290417e975346495bbb162a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae783a6f5cf4f1ebb771361053fc57d" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36535 } } peers { permanent_uuid: "51dd33915290417e975346495bbb162a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 42483 } } peers { permanent_uuid: "d2c4de1b019649b99bd7433ce71b9afd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39597 } }
I20260812 11:07:51.623868 8511 tablet_bootstrap.cc:492] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd: Bootstrap starting.
I20260812 11:07:51.624572 8507 ts_tablet_manager.cc:1428] T eeecd974c8c34a6dbd391f0629e22384 P 51dd33915290417e975346495bbb162a: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260812 11:07:51.625030 7983 heartbeater.cc:503] Master 127.18.174.254:45889 was elected leader, sending a full tablet report...
I20260812 11:07:51.627025 8505 raft_consensus.cc:348] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae783a6f5cf4f1ebb771361053fc57d" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36535 } } peers { permanent_uuid: "51dd33915290417e975346495bbb162a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 42483 } } peers { permanent_uuid: "d2c4de1b019649b99bd7433ce71b9afd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39597 } }
I20260812 11:07:51.627403 8505 raft_consensus.cc:374] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:07:51.627466 8505 raft_consensus.cc:729] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae783a6f5cf4f1ebb771361053fc57d, State: Initialized, Role: FOLLOWER
I20260812 11:07:51.628062 8505 consensus_queue.cc:260] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae783a6f5cf4f1ebb771361053fc57d" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36535 } } peers { permanent_uuid: "51dd33915290417e975346495bbb162a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 42483 } } peers { permanent_uuid: "d2c4de1b019649b99bd7433ce71b9afd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39597 } }
I20260812 11:07:51.629362 8505 ts_tablet_manager.cc:1428] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260812 11:07:51.629791 8468 heartbeater.cc:503] Master 127.18.174.254:45889 was elected leader, sending a full tablet report...
I20260812 11:07:51.633742 8511 tablet_bootstrap.cc:654] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd: Neither blocks nor log segments found. Creating new log.
I20260812 11:07:51.634953 8511 log.cc:824] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd: Log is configured to *not* fsync() on all Append() calls
I20260812 11:07:51.637948 8511 tablet_bootstrap.cc:492] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd: No bootstrap required, opened a new log
I20260812 11:07:51.638226 8511 ts_tablet_manager.cc:1397] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.000s
I20260812 11:07:51.643569 8511 raft_consensus.cc:348] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae783a6f5cf4f1ebb771361053fc57d" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36535 } } peers { permanent_uuid: "51dd33915290417e975346495bbb162a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 42483 } } peers { permanent_uuid: "d2c4de1b019649b99bd7433ce71b9afd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39597 } }
I20260812 11:07:51.643956 8511 raft_consensus.cc:374] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:07:51.644032 8511 raft_consensus.cc:729] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c4de1b019649b99bd7433ce71b9afd, State: Initialized, Role: FOLLOWER
I20260812 11:07:51.644779 8511 consensus_queue.cc:260] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae783a6f5cf4f1ebb771361053fc57d" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36535 } } peers { permanent_uuid: "51dd33915290417e975346495bbb162a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 42483 } } peers { permanent_uuid: "d2c4de1b019649b99bd7433ce71b9afd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39597 } }
I20260812 11:07:51.646127 8511 ts_tablet_manager.cc:1428] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260812 11:07:51.646600 8216 heartbeater.cc:503] Master 127.18.174.254:45889 was elected leader, sending a full tablet report...
Aug 12 11:07:51 dist-test-slave-lgr5 krb5kdc[6778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532870, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
W20260812 11:07:51.738701 8218 tablet.cc:2369] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:07:51.747998 8516 raft_consensus.cc:482] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:07:51.748309 8516 raft_consensus.cc:504] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae783a6f5cf4f1ebb771361053fc57d" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36535 } } peers { permanent_uuid: "51dd33915290417e975346495bbb162a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 42483 } } peers { permanent_uuid: "d2c4de1b019649b99bd7433ce71b9afd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39597 } }
I20260812 11:07:51.749917 8516 leader_election.cc:288] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51dd33915290417e975346495bbb162a (127.18.174.193:42483), d2c4de1b019649b99bd7433ce71b9afd (127.18.174.194:39597)
I20260812 11:07:51.756825 8470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:51.750377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:42483 (local address 127.18.174.195:49971)
0812 11:07:51.751161 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:51.751177 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:51.751281 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:51.752517 (+ 1236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:51.752521 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:51.752547 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:07:51.752684 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:51.752692 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.753868 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.753872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:51.755217 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:51.755233 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.756343 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.756348 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:51.756462 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.756492 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 11:07:51.756577 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 11:07:51.756671 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691}
I20260812 11:07:51.757859 8498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:51.751574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:49971 (local address 127.18.174.193:42483)
0812 11:07:51.751709 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:51.751714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:51.751729 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:07:51.751789 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:51.751792 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:51.751845 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:51.751918 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:07:51.752846 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.753701 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.755401 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.756016 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.756194 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.756254 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:51.757628 (+ 1374us) server_negotiation.cc:299] Negotiation successful
0812 11:07:51.757728 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 11:07:51.758625 8469 tablet.cc:2369] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:07:51.758639 7866 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecd974c8c34a6dbd391f0629e22384" candidate_uuid: "aae783a6f5cf4f1ebb771361053fc57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51dd33915290417e975346495bbb162a" is_pre_election: true
I20260812 11:07:51.759016 7866 raft_consensus.cc:2454] T eeecd974c8c34a6dbd391f0629e22384 P 51dd33915290417e975346495bbb162a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aae783a6f5cf4f1ebb771361053fc57d in term 0.
I20260812 11:07:51.759690 8263 leader_election.cc:302] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51dd33915290417e975346495bbb162a, aae783a6f5cf4f1ebb771361053fc57d; no voters:
I20260812 11:07:51.760232 8516 raft_consensus.cc:2781] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:07:51.760337 8516 raft_consensus.cc:482] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:07:51.760389 8516 raft_consensus.cc:3037] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:07:51.761752 8516 raft_consensus.cc:504] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae783a6f5cf4f1ebb771361053fc57d" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36535 } } peers { permanent_uuid: "51dd33915290417e975346495bbb162a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 42483 } } peers { permanent_uuid: "d2c4de1b019649b99bd7433ce71b9afd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39597 } }
I20260812 11:07:51.762676 8497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:51.752126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:43621 (local address 127.18.174.194:39597)
0812 11:07:51.752258 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:51.752263 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:51.757006 (+ 4743us) server_negotiation.cc:407] Connection header received
0812 11:07:51.757082 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:51.757086 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:51.757147 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:51.757230 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:07:51.758960 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.759737 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.761299 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.761902 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.762034 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.762092 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:51.762447 (+ 355us) server_negotiation.cc:299] Negotiation successful
0812 11:07:51.762545 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:07:51.762707 7866 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecd974c8c34a6dbd391f0629e22384" candidate_uuid: "aae783a6f5cf4f1ebb771361053fc57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51dd33915290417e975346495bbb162a"
I20260812 11:07:51.762842 7866 raft_consensus.cc:3037] T eeecd974c8c34a6dbd391f0629e22384 P 51dd33915290417e975346495bbb162a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:07:51.763154 8529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:51.750702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:39597 (local address 127.18.174.195:43621)
0812 11:07:51.756340 (+ 5638us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:51.756361 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:07:51.756488 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:07:51.758532 (+ 2044us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:07:51.758536 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:07:51.758565 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:07:51.758788 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:51.758799 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.759901 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.759905 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:51.761122 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:07:51.761136 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.762183 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.762187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:07:51.762285 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.762314 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 11:07:51.762901 (+ 587us) client_negotiation.cc:240] Negotiation successful
0812 11:07:51.762995 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5546,"thread_start_us":131,"threads_started":1}
I20260812 11:07:51.763868 8140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecd974c8c34a6dbd391f0629e22384" candidate_uuid: "aae783a6f5cf4f1ebb771361053fc57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c4de1b019649b99bd7433ce71b9afd" is_pre_election: true
I20260812 11:07:51.764245 8140 raft_consensus.cc:2454] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aae783a6f5cf4f1ebb771361053fc57d in term 0.
I20260812 11:07:51.764384 7866 raft_consensus.cc:2454] T eeecd974c8c34a6dbd391f0629e22384 P 51dd33915290417e975346495bbb162a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aae783a6f5cf4f1ebb771361053fc57d in term 1.
I20260812 11:07:51.764803 8263 leader_election.cc:302] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51dd33915290417e975346495bbb162a, aae783a6f5cf4f1ebb771361053fc57d; no voters:
I20260812 11:07:51.766021 8140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecd974c8c34a6dbd391f0629e22384" candidate_uuid: "aae783a6f5cf4f1ebb771361053fc57d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c4de1b019649b99bd7433ce71b9afd"
I20260812 11:07:51.766158 8140 raft_consensus.cc:3037] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:07:51.767433 8140 raft_consensus.cc:2454] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aae783a6f5cf4f1ebb771361053fc57d in term 1.
I20260812 11:07:51.767876 8516 leader_election.cc:288] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [CANDIDATE]: Term 1 election: Requested vote from peers 51dd33915290417e975346495bbb162a (127.18.174.193:42483), d2c4de1b019649b99bd7433ce71b9afd (127.18.174.194:39597)
I20260812 11:07:51.768126 8516 raft_consensus.cc:2781] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:07:51.768237 8516 raft_consensus.cc:686] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [term 1 LEADER]: Becoming Leader. State: Replica: aae783a6f5cf4f1ebb771361053fc57d, State: Running, Role: LEADER
I20260812 11:07:51.768643 8516 consensus_queue.cc:237] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae783a6f5cf4f1ebb771361053fc57d" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36535 } } peers { permanent_uuid: "51dd33915290417e975346495bbb162a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 42483 } } peers { permanent_uuid: "d2c4de1b019649b99bd7433ce71b9afd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39597 } }
I20260812 11:07:51.772986 7619 catalog_manager.cc:5495] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d reported cstate change: term changed from 0 to 1, leader changed from <none> to aae783a6f5cf4f1ebb771361053fc57d (127.18.174.195). New cstate: current_term: 1 leader_uuid: "aae783a6f5cf4f1ebb771361053fc57d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae783a6f5cf4f1ebb771361053fc57d" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 36535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51dd33915290417e975346495bbb162a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2c4de1b019649b99bd7433ce71b9afd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39597 } health_report { overall_health: UNKNOWN } } }
I20260812 11:07:51.829929 8495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:51.824025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33292 (local address 127.18.174.195:36535)
0812 11:07:51.824169 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 11:07:51.824174 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:07:51.824427 (+ 253us) server_negotiation.cc:407] Connection header received
0812 11:07:51.824534 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:07:51.824538 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:07:51.824620 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:07:51.824741 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:07:51.825212 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.826072 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.827415 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:07:51.827785 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:07:51.827918 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:07:51.828349 (+ 431us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:07:51.829017 (+ 668us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:07:51.829148 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 11:07:51.829676 (+ 528us) server_negotiation.cc:299] Negotiation successful
0812 11:07:51.829756 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 11:07:51.838649 7866 raft_consensus.cc:1261] T eeecd974c8c34a6dbd391f0629e22384 P 51dd33915290417e975346495bbb162a [term 1 FOLLOWER]: Refusing update from remote peer aae783a6f5cf4f1ebb771361053fc57d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:07:51.838649 8140 raft_consensus.cc:1261] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd [term 1 FOLLOWER]: Refusing update from remote peer aae783a6f5cf4f1ebb771361053fc57d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:07:51.839524 8531 consensus_queue.cc:1035] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c4de1b019649b99bd7433ce71b9afd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:07:51.840109 8531 consensus_queue.cc:1035] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [LEADER]: Connected to new peer: Peer: permanent_uuid: "51dd33915290417e975346495bbb162a" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:07:51.861300 7984 tablet.cc:2369] T eeecd974c8c34a6dbd391f0629e22384 P 51dd33915290417e975346495bbb162a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:07:51.862052 8538 mvcc.cc:205] Tried to move back new op lower bound from 7317638643039756288 to 7317638642768027648. Current Snapshot: MvccSnapshot[applied={T|T < 7317638643039756288 or (T in {7317638643039756288})}]
I20260812 11:07:51.865572 8540 mvcc.cc:205] Tried to move back new op lower bound from 7317638643039756288 to 7317638642768027648. Current Snapshot: MvccSnapshot[applied={T|T < 7317638643039756288}]
I20260812 11:07:51.872725 7619 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:07:51.872936 7619 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:07:51.876212 7619 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 061df93495494bd8865b3a0601b6c167: Sending DeleteTablet for 3 replicas of tablet eeecd974c8c34a6dbd391f0629e22384
I20260812 11:07:51.877540 7861 tablet_service.cc:1514] Processing DeleteTablet for tablet eeecd974c8c34a6dbd391f0629e22384 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:07:51 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:48616
I20260812 11:07:51.878158 8105 tablet_service.cc:1514] Processing DeleteTablet for tablet eeecd974c8c34a6dbd391f0629e22384 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:07:51 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:38156
I20260812 11:07:51.878948 8342 tablet_service.cc:1514] Processing DeleteTablet for tablet eeecd974c8c34a6dbd391f0629e22384 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:07:51 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:33290
I20260812 11:07:51.880128 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 7762
I20260812 11:07:51.900426 8559 tablet_replica.cc:330] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd: stopping tablet replica
I20260812 11:07:51.900928 8559 raft_consensus.cc:2229] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:07:51.901412 8559 raft_consensus.cc:2258] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:07:51.909991 8559 ts_tablet_manager.cc:1905] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:07:51.913160 8559 ts_tablet_manager.cc:1918] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:07:51.913278 8559 log.cc:1196] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/eeecd974c8c34a6dbd391f0629e22384
I20260812 11:07:51.913574 8559 ts_tablet_manager.cc:1939] T eeecd974c8c34a6dbd391f0629e22384 P d2c4de1b019649b99bd7433ce71b9afd: Deleting consensus metadata
I20260812 11:07:51.914984 8560 tablet_replica.cc:330] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d: stopping tablet replica
I20260812 11:07:51.915016 7592 catalog_manager.cc:4841] TS d2c4de1b019649b99bd7433ce71b9afd (127.18.174.194:39597): tablet eeecd974c8c34a6dbd391f0629e22384 (table test-table [id=8131786d7b6c4424b4195873a33f9815]) successfully deleted
I20260812 11:07:51.915419 8560 raft_consensus.cc:2229] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [term 1 LEADER]: Raft consensus shutting down.
W20260812 11:07:51.915787 7598 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:42483 (error 108)
I20260812 11:07:51.915966 8560 raft_consensus.cc:2258] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:07:51.916823 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 7993
I20260812 11:07:51.927695 8496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:07:51.927319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:42483 (local address 127.0.0.1:48630)
0812 11:07:51.927522 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 11:07:51.927596 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:42483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
W20260812 11:07:51.927906 7598 catalog_manager.cc:4584] TS 51dd33915290417e975346495bbb162a (127.18.174.193:42483): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet eeecd974c8c34a6dbd391f0629e22384: Network error: Client connection negotiation failed: client connection to 127.18.174.193:42483: connect: Connection refused (error 111)
I20260812 11:07:51.949311 8560 ts_tablet_manager.cc:1905] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:07:51.954025 8560 ts_tablet_manager.cc:1918] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:07:51.954294 8560 log.cc:1196] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/eeecd974c8c34a6dbd391f0629e22384
I20260812 11:07:51.954733 8560 ts_tablet_manager.cc:1939] T eeecd974c8c34a6dbd391f0629e22384 P aae783a6f5cf4f1ebb771361053fc57d: Deleting consensus metadata
I20260812 11:07:51.956416 7598 catalog_manager.cc:4841] TS aae783a6f5cf4f1ebb771361053fc57d (127.18.174.195:36535): tablet eeecd974c8c34a6dbd391f0629e22384 (table test-table [id=8131786d7b6c4424b4195873a33f9815]) successfully deleted
I20260812 11:07:51.963093 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 8224
I20260812 11:07:51.984016 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 7566
I20260812 11:07:52.009296 19131 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 11:07:52.355410 19131 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 11:07:52.355556 19131 mini_ranger.cc:66] Stopping Ranger...
I20260812 11:07:52.701113 19131 mini_ranger.cc:68] Stopped Ranger
2026-08-12 11:07:52.701 UTC [6829] LOG: received smart shutdown request
2026-08-12 11:07:52.706 UTC [6829] LOG: background worker "logical replication launcher" (PID 6844) exited with exit code 1
2026-08-12 11:07:52.706 UTC [6836] LOG: shutting down
2026-08-12 11:07:52.918 UTC [6829] LOG: database system is shut down
2026-08-12T11:07:52Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49810 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:07:53 dist-test-slave-lgr5 krb5kdc[8590](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:07:53 dist-test-slave-lgr5 krb5kdc[8590](info): set up 2 sockets
Aug 12 11:07:53 dist-test-slave-lgr5 krb5kdc[8590](info): commencing operation
krb5kdc: starting...
W20260812 11:07:54.243523 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:07:54 dist-test-slave-lgr5 krb5kdc[8590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:07:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:07:54Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.18.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.18.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/rangeradmin_127.18.174.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/rangeradmin_127.18.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.18.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.18.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/rangerlookup_127.18.174.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/rangerlookup_127.18.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.18.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/HTTP_127.18.174.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/HTTP_127.18.174.212@KRBTEST.COM.keytab.
I20260812 11:07:54.442844 19131 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskuq4X_z/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/postgres -l logfile start
2026-08-12 11:07:57.131 UTC [8648] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 11:07:57.131 UTC [8648] LOG: listening on IPv4 address "127.18.174.212", port 54809
2026-08-12 11:07:57.135 UTC [8648] LOG: listening on Unix socket "/tmp/.s.PGSQL.54809"
2026-08-12 11:07:57.165 UTC [8652] LOG: database system was shut down at 2026-08-12 11:07:55 UTC
2026-08-12 11:07:57.170 UTC [8648] LOG: database system is ready to accept connections
I20260812 11:07:58.294821 19131 mini_postgres.cc:96] Postgres bound to 54809
2026-08-12 11:07:58.302 UTC [8666] FATAL: database "slave" does not exist
127.18.174.212:54809 - accepting connections
I20260812 11:07:58.302691 19131 mini_ranger.cc:161] Starting Ranger...
I20260812 11:07:58.319114 19131 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 11:07:58.893613 19131 mini_ranger.cc:87] Created ranger Postgres database
I20260812 11:07:58.893704 19131 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-admin
2026-08-12 11:07:59,186 [I] DB FLAVOR :POSTGRES
2026-08-12 11:07:59,187 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:07:59,187 [I] Checking connection..
2026-08-12 11:07:59,187 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 11:07:59,453 [I] Checking connection passed.
2026-08-12 11:07:59,453 [I] --------- Verifying version history table ---------
2026-08-12 11:07:59,454 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:07:59,720 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:07:59,720 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:07:59,968 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:07:59,969 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 11:07:59,969 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 11:08:00.244 UTC [8793] WARNING: there is no transaction in progress
2026-08-12 11:08:00,254 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 11:08:00,254 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:08:00,532 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 11:08:00,532 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:08:00,533 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 11:08:00,805 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 11:08:01,067 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-lgr5.c.gcp-upstream.internal','N') ;"
2026-08-12 11:08:01,324 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:08:01,606 [I] Table x_portal_user does not exist in database ranger
2026-08-12 11:08:01,606 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:08:01,860 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 11:08:01,860 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:08:02,118 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:08:02,392 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 11:08:02,392 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 11:08:03.470 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:03.489 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:03.508 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:03.525 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:03.543 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:03.563 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:03.626 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:03.634 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:03.651 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:03.663 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:03.674 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:03.691 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:03.701 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:03.708 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:03.716 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:03.724 UTC [8992] WARNING: there is no transaction in progress
2026-08-12 11:08:04,484 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 11:08:04,484 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 11:08:04,717 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 11:08:04,718 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:08:04,975 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 11:08:04,975 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:08:05,256 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 11:08:05,256 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:08:05,525 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:08:05,799 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-lgr5.c.gcp-upstream.internal';"
2026-08-12 11:08:06,055 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 11:08:06,055 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 11:08:06,331 [I] DB_PATCHES have already been applied
I20260812 11:08:06.337419 19131 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-admin:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskuq4X_z/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 11:08:06.337493 19131 mini_ranger.cc:193] Using host: 127.18.174.212
I20260812 11:08:06.341931 19131 mini_ranger.cc:227] Ranger admin URL: http://127.18.174.212:47247
Aug 12, 2026 11:08:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:08:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:08:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 11:08:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 11:08:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 11:08:07 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 11:08:07 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 11:08:07.660632 19131 mini_ranger.cc:160] Time spent starting Ranger: real 9.358s user 0.004s sys 0.008s
Aug 12, 2026 11:08:29 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 11:08:29 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 12, 2026 11:08:29 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 11:08:29 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 11:08:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 11:08:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 11:08:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 11:08:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 11:08:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 11:08:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 11:08:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 11:08:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 11:08:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 11:08:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 11:08:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 11:08:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 11:08:29 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 11:08:30 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 11:08:31.090390 19131 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.18.174.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.18.174.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/rangerkms_127.18.174.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.18.174.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/rangerkms_127.18.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.174.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.18.174.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.174.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/HTTP_127.18.174.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.174.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/HTTP_127.18.174.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 11:08:31 dist-test-slave-lgr5 krb5kdc[8590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532911, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 11:08:31.188871 19131 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 11:08:31.201020 19131 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 11:08:32.167762 19131 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 11:08:32.167853 19131 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-kms
I20260812 11:08:32.167869 19131 mini_ranger_kms.cc:227] Using postgres at 127.18.174.212:54809
2026-08-12 11:08:32,337 [I] DB FLAVOR :POSTGRES
2026-08-12 11:08:32,338 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:08:32,338 [I] Checking connection
2026-08-12 11:08:32,338 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 11:08:32,581 [I] connection success
2026-08-12 11:08:32,581 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 11:08:32,582 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 11:08:32,582 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 11:08:32,853 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 11:08:32,854 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:08:32,854 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 11:08:32,854 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.174.212:54809/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 11:08:33,162 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 11:08:33.704491 19131 mini_ranger_kms.cc:310] Created kms service
I20260812 11:08:33.883677 19131 mini_ranger_kms.cc:326] Created kudu user
I20260812 11:08:33.926155 19131 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 11:08:33 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532911, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:08:34.357095 19131 mini_ranger_kms.cc:384] Added ranger policy
I20260812 11:08:34.357266 19131 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-kms:/tmp/dist-test-taskuq4X_z/build/debug/bin/postgresql.jar:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskuq4X_z/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 11:08:34.357288 19131 mini_ranger_kms.cc:240] Using host: 127.18.174.212
I20260812 11:08:34.362032 19131 mini_ranger_kms.cc:276] Ranger KMS PID: 9323
I20260812 11:08:34.362144 19131 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.18.174.212:54657
Aug 12, 2026 11:08:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:08:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:08:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 11:08:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 11:08:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 11:08:35 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 11:08:36 dist-test-slave-lgr5 krb5kdc[8590](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786532916, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.174.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:37.023800 19131 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.835s user 0.022s sys 0.134s
I20260812 11:08:37.023940 19131 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 11:08:37.024019 19131 mini_ranger_kms.cc:401] 127.18.174.212:54657/kms/v1/keys
Aug 12 11:08:37 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532916, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.174.212@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
Aug 12 11:08:37 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532916, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.174.212@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
Aug 12 11:08:39 dist-test-slave-lgr5 krb5kdc[8590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:08:39.851588 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45675
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:45675
--ranger_config_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.174.212:54657/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:08:39.970158 9416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:39.970480 9416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:39.970544 9416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:39.976459 9416 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:08:39.976545 9416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:39.976572 9416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:39.976594 9416 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:08:39.976640 9416 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:08:39.982808 9416 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/wal
--ranger_kms_url=127.18.174.212:54657/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:45675
--ranger_config_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:39.983965 9416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:39.985093 9416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:39.995198 9423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:39.995183 9422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:39.995503 9425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:39.995460 9416 server_base.cc:1034] running on GCE node
I20260812 11:08:39.996327 9416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:39.997598 9416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:39.998816 9416 hybrid_clock.cc:648] HybridClock initialized: now 1786532919998792 us; error 44 us; skew 500 ppm
Aug 12 11:08:39 dist-test-slave-lgr5 krb5kdc[8590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532919, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:40.001797 9416 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:08:40.002910 9416 webserver.cc:460] Webserver started at http://127.18.174.254:37589/ using document root <none> and password file <none>
I20260812 11:08:40.003507 9416 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:40.003569 9416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:40.003788 9416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:08:40 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532919, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:08:40.058758 9416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "c9408660651a4e9ab70446a68acf65b8"
format_stamp: "Formatted at 2026-08-12 11:08:40 on dist-test-slave-lgr5"
server_key: "ae4c879fbdb4850e8d6a7c68bfb312ac"
server_key_iv: "54cc8d91667962bbb01db362b9a26ad9"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:40.059499 9416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "c9408660651a4e9ab70446a68acf65b8"
format_stamp: "Formatted at 2026-08-12 11:08:40 on dist-test-slave-lgr5"
server_key: "ae4c879fbdb4850e8d6a7c68bfb312ac"
server_key_iv: "54cc8d91667962bbb01db362b9a26ad9"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:40.063694 9416 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260812 11:08:40.078298 9432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:40.079726 9416 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:08:40.079864 9416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "c9408660651a4e9ab70446a68acf65b8"
format_stamp: "Formatted at 2026-08-12 11:08:40 on dist-test-slave-lgr5"
server_key: "ae4c879fbdb4850e8d6a7c68bfb312ac"
server_key_iv: "54cc8d91667962bbb01db362b9a26ad9"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:40.080034 9416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:40.094023 9416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:40.097218 9416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:40.097410 9416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:40.105449 9416 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:45675
I20260812 11:08:40.105470 9522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:45675 every 8 connection(s)
I20260812 11:08:40.106534 9416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:08:40.109637 9525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:08:40.110821 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 9416
I20260812 11:08:40.110971 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:08:40.111321 19131 external_mini_cluster.cc:1428] Setting key 8466adb5979eaf24a740564295993886
I20260812 11:08:40.116910 9525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8: Bootstrap starting.
I20260812 11:08:40.119537 9525 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8: Neither blocks nor log segments found. Creating new log.
I20260812 11:08:40.120537 9525 log.cc:824] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:08:40 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:40.122821 9525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8: No bootstrap required, opened a new log
I20260812 11:08:40.126432 9525 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9408660651a4e9ab70446a68acf65b8" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45675 } }
I20260812 11:08:40.126775 9525 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:08:40.126890 9525 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9408660651a4e9ab70446a68acf65b8, State: Initialized, Role: FOLLOWER
I20260812 11:08:40.127449 9525 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9408660651a4e9ab70446a68acf65b8" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45675 } }
I20260812 11:08:40.127614 9525 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:08:40.127701 9525 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:08:40.127851 9525 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:08:40.129098 9525 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9408660651a4e9ab70446a68acf65b8" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45675 } }
I20260812 11:08:40.129470 9525 leader_election.cc:302] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9408660651a4e9ab70446a68acf65b8; no voters:
I20260812 11:08:40.129845 9525 leader_election.cc:288] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:08:40.129997 9531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:08:40.130249 9531 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 1 LEADER]: Becoming Leader. State: Replica: c9408660651a4e9ab70446a68acf65b8, State: Running, Role: LEADER
I20260812 11:08:40.130290 9529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:40.112990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51634 (local address 127.18.174.254:45675)
0812 11:08:40.113511 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:40.113532 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:40.113577 (+ 45us) server_negotiation.cc:407] Connection header received
0812 11:08:40.114420 (+ 843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:40.114447 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:40.114919 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:40.115327 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:40.116257 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:40.117686 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:40.118974 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:40.119694 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:40.119870 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:40.123269 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:40.123278 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:40.123301 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:40.123342 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:40.126365 (+ 3023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:40.127000 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:40.127007 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:40.127013 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:40.127155 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:40.127508 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:40.127512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:40.127514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:40.128193 (+ 679us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:40.128458 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:40.128772 (+ 314us) server_negotiation.cc:299] Negotiation successful
0812 11:08:40.129100 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":138,"threads_started":1}
I20260812 11:08:40.130645 9531 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9408660651a4e9ab70446a68acf65b8" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45675 } }
I20260812 11:08:40.131319 9525 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:08:40.133641 9525 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 11:08:40.133730 9532 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9408660651a4e9ab70446a68acf65b8. Latest consensus state: current_term: 1 leader_uuid: "c9408660651a4e9ab70446a68acf65b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9408660651a4e9ab70446a68acf65b8" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45675 } } }
I20260812 11:08:40.133924 9532 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [sys.catalog]: This master's current role is: LEADER
I20260812 11:08:40.133859 9533 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9408660651a4e9ab70446a68acf65b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9408660651a4e9ab70446a68acf65b8" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45675 } } }
I20260812 11:08:40.134091 9533 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [sys.catalog]: This master's current role is: LEADER
I20260812 11:08:40.134553 9556 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:08:40.140576 9556 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:08:40.148403 9556 catalog_manager.cc:1347] Generated new cluster ID: d6a18bdc41454e658c19fb6c52ff966a
I20260812 11:08:40.148484 9556 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:08:40.156702 9556 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:08:40.158270 9556 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:08:40.169983 9556 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8: Generated new TSK 0
I20260812 11:08:40.170972 9556 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:08:40.871817 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.174.212:54657/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45675
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:08:40.999496 9605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:40.999786 9605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:40.999848 9605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:41.004772 9605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:41.004858 9605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:41.004942 9605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:08:41.012678 9605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.18.174.212:54657/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:41.014385 9605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:41.015887 9605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:41.026966 9621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:41.027110 9620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:41.027438 9623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:41.027686 9605 server_base.cc:1034] running on GCE node
I20260812 11:08:41.028185 9605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:41.028882 9605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:41.036317 9605 hybrid_clock.cc:648] HybridClock initialized: now 1786532921036260 us; error 51 us; skew 500 ppm
Aug 12 11:08:41 dist-test-slave-lgr5 krb5kdc[8590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532921, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:41.040397 9605 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:08:41.041618 9605 webserver.cc:460] Webserver started at http://127.18.174.193:46003/ using document root <none> and password file <none>
I20260812 11:08:41.042253 9605 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:41.042330 9605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:41.042588 9605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:08:41 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532921, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:08:41.060020 9605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "5ff0c12f0d384885b9a106d0e8886dcb"
format_stamp: "Formatted at 2026-08-12 11:08:41 on dist-test-slave-lgr5"
server_key: "49ea4c0d4b990ce6eef5f023cf0f1472"
server_key_iv: "43addac014ece6721d60c0acf3fb8793"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:41.061370 9605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "5ff0c12f0d384885b9a106d0e8886dcb"
format_stamp: "Formatted at 2026-08-12 11:08:41 on dist-test-slave-lgr5"
server_key: "49ea4c0d4b990ce6eef5f023cf0f1472"
server_key_iv: "43addac014ece6721d60c0acf3fb8793"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:41.067366 9605 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260812 11:08:41.091828 9637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:41.106292 9605 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.003s sys 0.000s
I20260812 11:08:41.106582 9605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "5ff0c12f0d384885b9a106d0e8886dcb"
format_stamp: "Formatted at 2026-08-12 11:08:41 on dist-test-slave-lgr5"
server_key: "49ea4c0d4b990ce6eef5f023cf0f1472"
server_key_iv: "43addac014ece6721d60c0acf3fb8793"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:41.106820 9605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:41.126643 9605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:41.130527 9605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:41.130798 9605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:41.131551 9605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:08:41.132789 9605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:08:41.133004 9605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:41.133123 9605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:08:41.133193 9605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:41.145685 9605 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:38747
I20260812 11:08:41.147107 9605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:08:41.152406 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 9605
I20260812 11:08:41.152565 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:08:41.152915 19131 external_mini_cluster.cc:1428] Setting key 63c0662761b326ccc4dfda09e5253e58
I20260812 11:08:41.147823 9837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:38747 every 8 connection(s)
Aug 12 11:08:41 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532921, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:41.168586 9847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:41.150600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:44901 (local address 127.18.174.254:45675)
0812 11:08:41.154658 (+ 4058us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:41.154668 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:41.154682 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:08:41.154855 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:41.154859 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:41.154915 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:41.155039 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:41.156763 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:41.157674 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:41.159440 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:41.159780 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:41.159876 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:41.163136 (+ 3260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:41.163140 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:41.163143 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:41.163175 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:41.165131 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:41.165812 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:41.165816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:41.165819 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:41.165920 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:41.166362 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:41.166366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:41.166368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:41.166617 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:41.166713 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:41.168245 (+ 1532us) server_negotiation.cc:299] Negotiation successful
0812 11:08:41.168394 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3969,"thread_start_us":130,"threads_started":1}
I20260812 11:08:41.170050 9852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:41.151142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45675 (local address 127.18.174.193:44901)
0812 11:08:41.152901 (+ 1759us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:41.153103 (+ 202us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:41.154189 (+ 1086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:41.155392 (+ 1203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:41.155403 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:41.155793 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:41.156571 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:41.156594 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:41.157838 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:41.157842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:41.159283 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:41.159297 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:41.160121 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:41.160125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:41.160345 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:41.161063 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:41.161087 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:41.162894 (+ 1807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:41.165274 (+ 2380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:41.165281 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:41.165302 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:41.165687 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:41.166036 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:41.166039 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:41.166042 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:41.166249 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:41.166775 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:41.166782 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:41.167173 (+ 391us) client_negotiation.cc:769] Sending connection context
0812 11:08:41.167398 (+ 225us) client_negotiation.cc:240] Negotiation successful
0812 11:08:41.167776 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1499,"thread_start_us":150,"threads_started":1}
I20260812 11:08:41.171963 9838 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45675
I20260812 11:08:41.172272 9838 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:41.172900 9838 heartbeater.cc:511] Master 127.18.174.254:45675 requested a full tablet report, sending...
I20260812 11:08:41.174906 9464 ts_manager.cc:194] Registered new tserver with Master: 5ff0c12f0d384885b9a106d0e8886dcb (127.18.174.193:38747)
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
I20260812 11:08:41.176574 9464 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:44901
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:08:41.203289 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.174.212:54657/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45675
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:08:41 dist-test-slave-lgr5 krb5kdc[8590](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786532921, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 11:08:41.363183 9857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:41.363716 9857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:41.363855 9857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:41.370368 9857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:41.370569 9857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:41.370716 9857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:08:41.379387 9857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.18.174.212:54657/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:41.381292 9857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:41.382875 9857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:08:41.396612 9857 server_base.cc:1034] running on GCE node
W20260812 11:08:41.396860 9870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:41.397113 9872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:41.397248 9876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:41.397835 9857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:41.398780 9857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:41.399992 9857 hybrid_clock.cc:648] HybridClock initialized: now 1786532921399964 us; error 47 us; skew 500 ppm
Aug 12 11:08:41 dist-test-slave-lgr5 krb5kdc[8590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532921, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:41.403934 9857 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:08:41.405393 9857 webserver.cc:460] Webserver started at http://127.18.174.194:34131/ using document root <none> and password file <none>
I20260812 11:08:41.406261 9857 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:41.406371 9857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:41.406734 9857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:08:41 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532921, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:08:41.424453 9857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "100bf760b62d4d80ae5dff627a6f8ca9"
format_stamp: "Formatted at 2026-08-12 11:08:41 on dist-test-slave-lgr5"
server_key: "ed355d91aa3b68e0f5e3de6f08d1ba33"
server_key_iv: "62d6fda463141a9f92f76c59691a6d8a"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:41.425443 9857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "100bf760b62d4d80ae5dff627a6f8ca9"
format_stamp: "Formatted at 2026-08-12 11:08:41 on dist-test-slave-lgr5"
server_key: "ed355d91aa3b68e0f5e3de6f08d1ba33"
server_key_iv: "62d6fda463141a9f92f76c59691a6d8a"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:41.431552 9857 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260812 11:08:41.449231 9887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:41.451191 9857 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:08:41.451359 9857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "100bf760b62d4d80ae5dff627a6f8ca9"
format_stamp: "Formatted at 2026-08-12 11:08:41 on dist-test-slave-lgr5"
server_key: "ed355d91aa3b68e0f5e3de6f08d1ba33"
server_key_iv: "62d6fda463141a9f92f76c59691a6d8a"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:41.451576 9857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:41.483719 9857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:41.487870 9857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:41.488180 9857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:41.488991 9857 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:08:41.490365 9857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:08:41.490478 9857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:41.490572 9857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:08:41.490633 9857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:41.500994 9857 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:43635
I20260812 11:08:41.502401 9857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:08:41.505265 10090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:43635 every 8 connection(s)
I20260812 11:08:41.509168 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 9857
I20260812 11:08:41.509308 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:08:41.509658 19131 external_mini_cluster.cc:1428] Setting key c71f77bb801142cadfc9f44522fb9019
Aug 12 11:08:41 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532921, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:41.530244 9847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:41.507185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:45013 (local address 127.18.174.254:45675)
0812 11:08:41.508867 (+ 1682us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:41.508872 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:41.508894 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:08:41.513187 (+ 4293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:41.513192 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:41.513260 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:41.513317 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:41.515298 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:41.516195 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:41.518048 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:41.518451 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:41.518535 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:41.522032 (+ 3497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:41.522037 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:41.522040 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:41.522075 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:41.523835 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:41.526274 (+ 2439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:41.526279 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:41.526281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:41.526391 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:41.528680 (+ 2289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:41.528684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:41.528686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:41.528973 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:41.529073 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:41.529882 (+ 809us) server_negotiation.cc:299] Negotiation successful
0812 11:08:41.530058 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1570}
I20260812 11:08:41.532284 10097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:41.507670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45675 (local address 127.18.174.194:45013)
0812 11:08:41.508285 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:41.508349 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:41.512771 (+ 4422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:41.513861 (+ 1090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:41.513873 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:41.514288 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:41.515094 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:41.515121 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:41.516388 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:41.516392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:41.517889 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:41.517902 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:41.518774 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:41.518778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:41.519019 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:41.519758 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:41.519782 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:41.521783 (+ 2001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:41.524166 (+ 2383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:41.524175 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:41.524197 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:41.524605 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:41.528255 (+ 3650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:41.528258 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:41.528260 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:41.528536 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:41.529156 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:41.529164 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:41.529571 (+ 407us) client_negotiation.cc:769] Sending connection context
0812 11:08:41.530469 (+ 898us) client_negotiation.cc:240] Negotiation successful
0812 11:08:41.530888 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":169,"threads_started":1}
I20260812 11:08:41.534022 10094 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45675
I20260812 11:08:41.534310 10094 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:41.534993 10094 heartbeater.cc:511] Master 127.18.174.254:45675 requested a full tablet report, sending...
I20260812 11:08:41.536418 9464 ts_manager.cc:194] Registered new tserver with Master: 100bf760b62d4d80ae5dff627a6f8ca9 (127.18.174.194:43635)
I20260812 11:08:41.537211 9464 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:45013
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:08:41.572362 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.174.212:54657/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45675
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:08:41 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532921, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
W20260812 11:08:41.748862 10102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:41.749193 10102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:41.749257 10102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:41.753741 10102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:41.753823 10102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:41.753906 10102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:08:41.759990 10102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.18.174.212:54657/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:41.761263 10102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:41.762449 10102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:41.773270 10116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:41.773270 10108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:41.773270 10114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:41.773818 10102 server_base.cc:1034] running on GCE node
I20260812 11:08:41.774286 10102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:41.775051 10102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:41.776217 10102 hybrid_clock.cc:648] HybridClock initialized: now 1786532921776173 us; error 63 us; skew 500 ppm
Aug 12 11:08:41 dist-test-slave-lgr5 krb5kdc[8590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532921, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:41.779307 10102 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:08:41.780407 10102 webserver.cc:460] Webserver started at http://127.18.174.195:36129/ using document root <none> and password file <none>
I20260812 11:08:41.781220 10102 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:41.781324 10102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:41.781605 10102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:08:41 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532921, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:08:41.806280 10102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "1e01e0a3e3f2499eaf80d842cc59041c"
format_stamp: "Formatted at 2026-08-12 11:08:41 on dist-test-slave-lgr5"
server_key: "dec4822a22d39c459b19ab65b9543dd1"
server_key_iv: "ed97f0471a15b725fa05c349a83bef69"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:41.807240 10102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "1e01e0a3e3f2499eaf80d842cc59041c"
format_stamp: "Formatted at 2026-08-12 11:08:41 on dist-test-slave-lgr5"
server_key: "dec4822a22d39c459b19ab65b9543dd1"
server_key_iv: "ed97f0471a15b725fa05c349a83bef69"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:41.812879 10102 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 11:08:41.840494 10127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:41.842620 10102 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.003s sys 0.001s
I20260812 11:08:41.842883 10102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "1e01e0a3e3f2499eaf80d842cc59041c"
format_stamp: "Formatted at 2026-08-12 11:08:41 on dist-test-slave-lgr5"
server_key: "dec4822a22d39c459b19ab65b9543dd1"
server_key_iv: "ed97f0471a15b725fa05c349a83bef69"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:41.843155 10102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:41.897974 10102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:41.902338 10102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:41.902679 10102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:41.903546 10102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:08:41.904862 10102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:08:41.905002 10102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:41.905156 10102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:08:41.905229 10102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:41.920244 10102 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:45589
I20260812 11:08:41.921665 10102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:08:41.923781 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 10102
I20260812 11:08:41.923911 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:08:41.924261 19131 external_mini_cluster.cc:1428] Setting key f4eea80008f9b66fb133814f937e17fb
I20260812 11:08:41.923184 10321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:45589 every 8 connection(s)
Aug 12 11:08:41 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532921, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:41.956601 9847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:41.927414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:58243 (local address 127.18.174.254:45675)
0812 11:08:41.927544 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:41.927549 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:41.932753 (+ 5204us) server_negotiation.cc:407] Connection header received
0812 11:08:41.934122 (+ 1369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:41.934126 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:41.934190 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:41.934244 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:41.936211 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:41.937031 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:41.942942 (+ 5911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:41.943313 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:41.943410 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:41.951812 (+ 8402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:41.951817 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:41.951821 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:41.951858 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:41.953751 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:41.954527 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:41.954531 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:41.954533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:41.954636 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:41.955123 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:41.955127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:41.955129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:41.955377 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:41.955469 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:41.956271 (+ 802us) server_negotiation.cc:299] Negotiation successful
0812 11:08:41.956413 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:08:41.958679 10324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:41.926212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45675 (local address 127.18.174.195:58243)
0812 11:08:41.932511 (+ 6299us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:41.932599 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:41.933806 (+ 1207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:41.934740 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:41.934751 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:41.935199 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:41.935973 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:41.935996 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:41.939968 (+ 3972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:41.939973 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:41.941616 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:41.941635 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:41.947867 (+ 6232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:41.947873 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:41.948212 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:41.949094 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:41.949121 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:41.951561 (+ 2440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:41.953926 (+ 2365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:41.953935 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:41.953957 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:41.954370 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:41.954756 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:41.954759 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:41.954761 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:41.954983 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:41.955543 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:41.955550 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:41.955933 (+ 383us) client_negotiation.cc:769] Sending connection context
0812 11:08:41.957108 (+ 1175us) client_negotiation.cc:240] Negotiation successful
0812 11:08:41.957526 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5972,"thread_start_us":181,"threads_started":1}
I20260812 11:08:41.960395 10322 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45675
I20260812 11:08:41.960688 10322 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:41.961293 10322 heartbeater.cc:511] Master 127.18.174.254:45675 requested a full tablet report, sending...
I20260812 11:08:41.963258 9464 ts_manager.cc:194] Registered new tserver with Master: 1e01e0a3e3f2499eaf80d842cc59041c (127.18.174.195:45589)
I20260812 11:08:41.964288 9464 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:58243
I20260812 11:08:41.967978 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:08:41.968852 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 9605
Aug 12 11:08:41 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532921, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:08:42.016415 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 9857
I20260812 11:08:42.039505 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 10102
I20260812 11:08:42.073321 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 9416
I20260812 11:08:42.096410 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45675
--webserver_interface=127.18.174.254
--webserver_port=37589
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:45675
--ranger_config_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.174.212:54657/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.174.212:54657/kms with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:08:42.237123 10330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:42.237426 10330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:42.237468 10330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:42.241640 10330 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:08:42.241716 10330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:42.241734 10330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:42.241750 10330 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:08:42.241763 10330 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:08:42.247656 10330 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.174.212:54657/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:45675
--ranger_config_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=37589
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:42.248898 10330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:42.249996 10330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:42.259047 10340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:42.259068 10343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:42.259166 10330 server_base.cc:1034] running on GCE node
W20260812 11:08:42.259045 10338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:42.259889 10330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:42.261142 10330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:42.262307 10330 hybrid_clock.cc:648] HybridClock initialized: now 1786532922262276 us; error 54 us; skew 500 ppm
Aug 12 11:08:42 dist-test-slave-lgr5 krb5kdc[8590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532922, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:42.269819 10330 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:08:42.270809 10330 webserver.cc:460] Webserver started at http://127.18.174.254:37589/ using document root <none> and password file <none>
I20260812 11:08:42.271376 10330 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:42.271451 10330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:08:42 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532922, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:08:42.328176 10330 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:08:42.330792 10351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:42.332369 10330 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:08:42.332530 10330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "c9408660651a4e9ab70446a68acf65b8"
format_stamp: "Formatted at 2026-08-12 11:08:40 on dist-test-slave-lgr5"
server_key: "ae4c879fbdb4850e8d6a7c68bfb312ac"
server_key_iv: "54cc8d91667962bbb01db362b9a26ad9"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:42.333133 10330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:42.360404 10330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:42.363621 10330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:42.363828 10330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:42.371485 10330 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:45675
I20260812 11:08:42.371487 10437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:45675 every 8 connection(s)
I20260812 11:08:42.372681 10330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:08:42.376356 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 10330
I20260812 11:08:42.376804 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.174.212:54657/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:38747
--local_ip_for_outbound_sockets=127.18.174.193
--tserver_master_addrs=127.18.174.254:45675
--webserver_port=46003
--webserver_interface=127.18.174.193
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.174.212:54657/kms with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:08:42.377564 10439 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:08:42.379462 10439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8: Bootstrap starting.
I20260812 11:08:42.396981 10439 log.cc:824] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:42.403956 10439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:08:42.404405 10439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8: Bootstrap complete.
I20260812 11:08:42.408566 10439 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9408660651a4e9ab70446a68acf65b8" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45675 } }
I20260812 11:08:42.409020 10439 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9408660651a4e9ab70446a68acf65b8, State: Initialized, Role: FOLLOWER
I20260812 11:08:42.409539 10439 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9408660651a4e9ab70446a68acf65b8" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45675 } }
I20260812 11:08:42.409675 10439 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:08:42.409747 10439 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:08:42.409847 10439 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:08:42.411945 10439 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9408660651a4e9ab70446a68acf65b8" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45675 } }
I20260812 11:08:42.412328 10439 leader_election.cc:302] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9408660651a4e9ab70446a68acf65b8; no voters:
I20260812 11:08:42.412662 10439 leader_election.cc:288] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:08:42.412801 10444 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:08:42.413017 10444 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [term 2 LEADER]: Becoming Leader. State: Replica: c9408660651a4e9ab70446a68acf65b8, State: Running, Role: LEADER
I20260812 11:08:42.413337 10444 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9408660651a4e9ab70446a68acf65b8" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45675 } }
I20260812 11:08:42.414023 10439 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:08:42.414812 10448 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c9408660651a4e9ab70446a68acf65b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9408660651a4e9ab70446a68acf65b8" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45675 } } }
I20260812 11:08:42.414971 10448 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [sys.catalog]: This master's current role is: LEADER
I20260812 11:08:42.415267 10449 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9408660651a4e9ab70446a68acf65b8. Latest consensus state: current_term: 2 leader_uuid: "c9408660651a4e9ab70446a68acf65b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9408660651a4e9ab70446a68acf65b8" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45675 } } }
I20260812 11:08:42.415359 10449 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8 [sys.catalog]: This master's current role is: LEADER
I20260812 11:08:42.416172 10459 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:08:42.416565 10439 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 11:08:42.422895 10459 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:08:42.423938 10459 catalog_manager.cc:1259] Loaded cluster ID: d6a18bdc41454e658c19fb6c52ff966a
I20260812 11:08:42.424015 10459 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:08:42.426867 10459 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:08:42.427673 10459 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8: Loaded TSK: 0
I20260812 11:08:42.429261 10459 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:08:42.534972 10442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:42.535399 10442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:42.535470 10442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:42.541791 10442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:42.541903 10442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:42.541993 10442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:08:42.551709 10442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.174.212:54657/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:38747
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=46003
--tserver_master_addrs=127.18.174.254:45675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:42.553318 10442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:42.554818 10442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:42.569195 10508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:42.569188 10510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:42.569190 10512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:42.570669 10442 server_base.cc:1034] running on GCE node
I20260812 11:08:42.571252 10442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:42.572228 10442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:42.573438 10442 hybrid_clock.cc:648] HybridClock initialized: now 1786532922573406 us; error 47 us; skew 500 ppm
Aug 12 11:08:42 dist-test-slave-lgr5 krb5kdc[8590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532922, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:42.577419 10442 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:08:42.578644 10442 webserver.cc:460] Webserver started at http://127.18.174.193:46003/ using document root <none> and password file <none>
I20260812 11:08:42.579397 10442 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:42.579520 10442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:08:42 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532922, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:08:42.600700 10442 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:08:42.605844 10529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:42.607800 10442 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260812 11:08:42.607978 10442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "5ff0c12f0d384885b9a106d0e8886dcb"
format_stamp: "Formatted at 2026-08-12 11:08:41 on dist-test-slave-lgr5"
server_key: "49ea4c0d4b990ce6eef5f023cf0f1472"
server_key_iv: "43addac014ece6721d60c0acf3fb8793"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:42.608865 10442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:42.641201 10442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:42.644666 10442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:42.644908 10442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:42.645732 10442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:08:42.647032 10442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:08:42.647092 10442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:42.647152 10442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:08:42.647176 10442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:42.662441 10442 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:38747
I20260812 11:08:42.663964 10442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:08:42.665969 10706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:38747 every 8 connection(s)
I20260812 11:08:42.667397 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 10442
I20260812 11:08:42.668215 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.174.212:54657/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:43635
--local_ip_for_outbound_sockets=127.18.174.194
--tserver_master_addrs=127.18.174.254:45675
--webserver_port=34131
--webserver_interface=127.18.174.194
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.174.212:54657/kms with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:08:42 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532922, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:42.691193 10711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:42.667062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45675 (local address 127.18.174.193:43603)
0812 11:08:42.672667 (+ 5605us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:42.672754 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:42.673956 (+ 1202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:42.676303 (+ 2347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:42.676313 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:42.676712 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:42.677426 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:42.677449 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:42.679439 (+ 1990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:42.679442 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:42.680937 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:42.680951 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:42.682256 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:42.682260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:42.682453 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:42.683118 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:42.683140 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:42.684937 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:42.687401 (+ 2464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:42.687408 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:42.687425 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:42.687781 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:42.688227 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:42.688230 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:42.688233 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:42.688410 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:42.689237 (+ 827us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:42.689244 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:42.689605 (+ 361us) client_negotiation.cc:769] Sending connection context
0812 11:08:42.689807 (+ 202us) client_negotiation.cc:240] Negotiation successful
0812 11:08:42.690148 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5309,"thread_start_us":164,"threads_started":1}
I20260812 11:08:42.693075 10714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:42.670392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:43603 (local address 127.18.174.254:45675)
0812 11:08:42.670961 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:42.671000 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:42.674358 (+ 3358us) server_negotiation.cc:407] Connection header received
0812 11:08:42.674754 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:42.674770 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:42.675277 (+ 507us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:42.675696 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:42.677668 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:42.679242 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:42.681099 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:42.681851 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:42.682014 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:42.685186 (+ 3172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:42.685193 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:42.685211 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:42.685246 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:42.687253 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:42.687926 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:42.687934 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:42.687940 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:42.688120 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:42.688525 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:42.688528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:42.688530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:42.689034 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:42.689171 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:42.691769 (+ 2598us) server_negotiation.cc:299] Negotiation successful
0812 11:08:42.692100 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":121,"threads_started":1}
I20260812 11:08:42.696542 10707 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45675
I20260812 11:08:42.696825 10707 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:42.697423 10707 heartbeater.cc:511] Master 127.18.174.254:45675 requested a full tablet report, sending...
W20260812 11:08:42.700551 10707 heartbeater.cc:644] Failed to heartbeat to 127.18.174.254:45675 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 11:08:42.700680 10707 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:42.701006 10707 heartbeater.cc:511] Master 127.18.174.254:45675 requested a full tablet report, sending...
I20260812 11:08:42.702024 10707 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:42.702198 10707 heartbeater.cc:511] Master 127.18.174.254:45675 requested a full tablet report, sending...
W20260812 11:08:42.703019 10707 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:08:42.839586 10712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:42.840011 10712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:42.840107 10712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:42.846421 10712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:42.846511 10712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:42.846596 10712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:08:42.854540 10712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.174.212:54657/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:43635
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=34131
--tserver_master_addrs=127.18.174.254:45675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:42.856099 10712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:42.857511 10712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:42.870406 10724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:42.870796 10721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:42.870836 10712 server_base.cc:1034] running on GCE node
W20260812 11:08:42.872265 10720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:42.872844 10712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:42.873706 10712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:42.874902 10712 hybrid_clock.cc:648] HybridClock initialized: now 1786532922874866 us; error 40 us; skew 500 ppm
Aug 12 11:08:42 dist-test-slave-lgr5 krb5kdc[8590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532922, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:42.878738 10712 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:08:42.880105 10712 webserver.cc:460] Webserver started at http://127.18.174.194:34131/ using document root <none> and password file <none>
I20260812 11:08:42.880900 10712 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:42.881031 10712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:08:42 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532922, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:08:42.913894 10712 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 11:08:42.925184 10737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:42.927320 10712 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.002s sys 0.000s
I20260812 11:08:42.927523 10712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "100bf760b62d4d80ae5dff627a6f8ca9"
format_stamp: "Formatted at 2026-08-12 11:08:41 on dist-test-slave-lgr5"
server_key: "ed355d91aa3b68e0f5e3de6f08d1ba33"
server_key_iv: "62d6fda463141a9f92f76c59691a6d8a"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:42.928428 10712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:42.948189 10712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:42.952302 10712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:42.952559 10712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:42.953405 10712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:08:42.954593 10712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:08:42.954663 10712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:42.954725 10712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:08:42.954757 10712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:42.967053 10712 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:43635
I20260812 11:08:42.968623 10712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:08:42.974591 10947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:43635 every 8 connection(s)
I20260812 11:08:42.978842 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 10712
I20260812 11:08:42.979466 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.174.212:54657/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:45589
--local_ip_for_outbound_sockets=127.18.174.195
--tserver_master_addrs=127.18.174.254:45675
--webserver_port=36129
--webserver_interface=127.18.174.195
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:45103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.174.212:54657/kms with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:08:42 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532922, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:42.994650 10714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:42.978819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:48797 (local address 127.18.174.254:45675)
0812 11:08:42.979036 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:42.979041 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:42.979869 (+ 828us) server_negotiation.cc:407] Connection header received
0812 11:08:42.981250 (+ 1381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:42.981254 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:42.981322 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:42.981425 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:42.983169 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:42.983944 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:42.985838 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:42.986229 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:42.986327 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:42.989835 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:42.989840 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:42.989842 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:42.989877 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:42.991697 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:42.992549 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:42.992554 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:42.992556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:42.992662 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:42.993141 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:42.993146 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:42.993147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:42.993399 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:42.993497 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:42.994312 (+ 815us) server_negotiation.cc:299] Negotiation successful
0812 11:08:42.994471 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 11:08:43.004463 10951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:42.977451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45675 (local address 127.18.174.194:48797)
0812 11:08:42.979590 (+ 2139us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:42.979746 (+ 156us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:42.980941 (+ 1195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:42.981785 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:42.981797 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:42.982200 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:42.982938 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:42.982980 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:42.984139 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:42.984143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:42.985653 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:42.985669 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:42.986594 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:42.986599 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:42.986827 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:42.987611 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:42.987636 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:42.989573 (+ 1937us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:42.991858 (+ 2285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:42.991875 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:42.991898 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:42.992373 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:42.992763 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:42.992766 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:42.992768 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:42.993013 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:42.993573 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:42.993581 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:42.993952 (+ 371us) client_negotiation.cc:769] Sending connection context
0812 11:08:42.994214 (+ 262us) client_negotiation.cc:240] Negotiation successful
0812 11:08:42.994611 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1885,"thread_start_us":174,"threads_started":1}
I20260812 11:08:43.006503 10949 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45675
I20260812 11:08:43.006821 10949 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:43.007566 10949 heartbeater.cc:511] Master 127.18.174.254:45675 requested a full tablet report, sending...
W20260812 11:08:43.009717 10949 heartbeater.cc:644] Failed to heartbeat to 127.18.174.254:45675 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 11:08:43.009879 10949 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:43.010113 10949 heartbeater.cc:511] Master 127.18.174.254:45675 requested a full tablet report, sending...
I20260812 11:08:43.011096 10949 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:43.011293 10949 heartbeater.cc:511] Master 127.18.174.254:45675 requested a full tablet report, sending...
W20260812 11:08:43.012209 10949 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:08:43.126701 10955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:43.127120 10955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:43.127194 10955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:43.133479 10955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:43.133565 10955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:43.133648 10955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:08:43.139881 10955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:45103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.174.212:54657/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:45589
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=36129
--tserver_master_addrs=127.18.174.254:45675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:43.141083 10955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:43.142174 10955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:43.152810 10973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:43.152824 10969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:43.153324 10955 server_base.cc:1034] running on GCE node
W20260812 11:08:43.154059 10966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:43.154660 10955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:43.155617 10955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:43.158952 10955 hybrid_clock.cc:648] HybridClock initialized: now 1786532923158574 us; error 378 us; skew 500 ppm
Aug 12 11:08:43 dist-test-slave-lgr5 krb5kdc[8590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532923, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:43.162562 10955 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:08:43.163652 10955 webserver.cc:460] Webserver started at http://127.18.174.195:36129/ using document root <none> and password file <none>
I20260812 11:08:43.164361 10955 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:43.164502 10955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:08:43 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532923, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:08:43.193591 10955 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.003s sys 0.001s
I20260812 11:08:43.197620 10987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:43.199541 10955 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:08:43.199713 10955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "1e01e0a3e3f2499eaf80d842cc59041c"
format_stamp: "Formatted at 2026-08-12 11:08:41 on dist-test-slave-lgr5"
server_key: "dec4822a22d39c459b19ab65b9543dd1"
server_key_iv: "ed97f0471a15b725fa05c349a83bef69"
server_key_version: "kuduclusterkey@0"
I20260812 11:08:43.200585 10955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:43.245795 10955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:43.249850 10955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:43.250083 10955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:43.250944 10955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:08:43.252234 10955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:08:43.252301 10955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:43.252351 10955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:08:43.252378 10955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:43.263649 10955 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:45589
I20260812 11:08:43.264532 11190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:45589 every 8 connection(s)
I20260812 11:08:43.264856 10955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:08:43.271891 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 10955
Aug 12 11:08:43 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532923, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:43.282698 10714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:43.267083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:38067 (local address 127.18.174.254:45675)
0812 11:08:43.267249 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:43.267254 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:43.268285 (+ 1031us) server_negotiation.cc:407] Connection header received
0812 11:08:43.269279 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:43.269283 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:43.269344 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:43.269450 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:43.270727 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:43.271597 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:43.273263 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:43.273661 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:43.273775 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:43.277714 (+ 3939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:43.277719 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:43.277721 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:43.277755 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:43.279666 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:43.280610 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:43.280614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:43.280616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:43.280728 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:43.281239 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:43.281243 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:43.281245 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:43.281509 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:43.281614 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:43.282382 (+ 768us) server_negotiation.cc:299] Negotiation successful
0812 11:08:43.282527 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:08:43.283800 11194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:43.267491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45675 (local address 127.18.174.195:38067)
0812 11:08:43.268072 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:43.268164 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:43.269048 (+ 884us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:43.269667 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:43.269675 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:43.269978 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:43.270543 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:43.270558 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:43.271781 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:43.271785 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:43.273129 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:43.273142 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:43.273972 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:43.273977 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:43.274215 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:43.274989 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:43.275031 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:43.277469 (+ 2438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:43.279835 (+ 2366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:43.279845 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:43.279870 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:43.280480 (+ 610us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:43.280837 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:43.280841 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:43.280844 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:43.281113 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:43.281643 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:43.281652 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:43.282055 (+ 403us) client_negotiation.cc:769] Sending connection context
0812 11:08:43.282327 (+ 272us) client_negotiation.cc:240] Negotiation successful
0812 11:08:43.282710 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":189,"threads_started":1}
I20260812 11:08:43.284121 11197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:43.272727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51642 (local address 127.18.174.254:45675)
0812 11:08:43.273186 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:43.273194 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:43.273609 (+ 415us) server_negotiation.cc:407] Connection header received
0812 11:08:43.273655 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:43.273658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:43.273711 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:43.273793 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:43.274862 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:43.275752 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:43.277099 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:43.277469 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:43.277590 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:43.280148 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:43.280152 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:43.280155 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:43.280188 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:43.282164 (+ 1976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:43.282874 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:43.282877 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:43.282879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:43.282960 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:43.283256 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:43.283259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:43.283261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:43.283445 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:43.283640 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:43.283820 (+ 180us) server_negotiation.cc:299] Negotiation successful
0812 11:08:43.283935 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":132,"threads_started":1}
I20260812 11:08:43.285302 11191 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45675
I20260812 11:08:43.285595 11191 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:43.286141 11191 heartbeater.cc:511] Master 127.18.174.254:45675 requested a full tablet report, sending...
I20260812 11:08:43.287736 10377 ts_manager.cc:194] Registered new tserver with Master: 1e01e0a3e3f2499eaf80d842cc59041c (127.18.174.195:45589)
I20260812 11:08:43.289490 10377 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:38067
Aug 12 11:08:43 dist-test-slave-lgr5 krb5kdc[8590](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786532923, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:43.703240 10707 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:43.703536 10707 heartbeater.cc:511] Master 127.18.174.254:45675 requested a full tablet report, sending...
I20260812 11:08:43.704314 10377 ts_manager.cc:194] Registered new tserver with Master: 5ff0c12f0d384885b9a106d0e8886dcb (127.18.174.193:38747)
I20260812 11:08:43.705120 10377 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:43603
I20260812 11:08:44.012447 10949 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:44.012781 10949 heartbeater.cc:511] Master 127.18.174.254:45675 requested a full tablet report, sending...
I20260812 11:08:44.013856 10377 ts_manager.cc:194] Registered new tserver with Master: 100bf760b62d4d80ae5dff627a6f8ca9 (127.18.174.194:43635)
I20260812 11:08:44.014653 10377 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:48797
I20260812 11:08:44.018636 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:08:44 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532923, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:08:44.039150 11214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:44.024624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51644 (local address 127.18.174.254:45675)
0812 11:08:44.028473 (+ 3849us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:44.028477 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:44.028496 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:08:44.028550 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:44.028554 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:44.028610 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:44.028706 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:44.029708 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.030535 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.031711 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.032070 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.032203 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:44.034025 (+ 1822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:44.034029 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:44.034031 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:44.034067 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:44.036124 (+ 2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:44.037072 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:44.037076 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:44.037078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:44.037189 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:44.037594 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:44.037598 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:44.037600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:44.037854 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:44.037994 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:44.038847 (+ 853us) server_negotiation.cc:299] Negotiation successful
0812 11:08:44.039012 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3040,"thread_start_us":100,"threads_started":1}
I20260812 11:08:44.046025 10377 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51644:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:08:44.050788 10377 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:08:44.125160 11226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:44.109744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45589 (local address 127.0.0.1:43632)
0812 11:08:44.115182 (+ 5438us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:44.115197 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:44.115283 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:44.118460 (+ 3177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:44.118464 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:44.118487 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:08:44.118598 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:44.118605 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.120149 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.120153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:44.123113 (+ 2960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:44.123125 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.124571 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.124575 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:44.124698 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:44.124741 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 11:08:44.124853 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 11:08:44.124987 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5364,"mutex_wait_us":1,"thread_start_us":95,"threads_started":1}
I20260812 11:08:44.126686 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:44.111374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:38747 (local address 127.0.0.1:54818)
0812 11:08:44.120249 (+ 8875us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:44.120265 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:44.120369 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:44.121261 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:44.121264 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:44.121282 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:08:44.121390 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:44.121396 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.122733 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.122737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:44.123901 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:44.123912 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.126271 (+ 2359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.126275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:44.126374 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:44.126403 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 11:08:44.126469 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 11:08:44.126545 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8802,"mutex_wait_us":34,"thread_start_us":96,"threads_started":1}
I20260812 11:08:44.127267 11238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:44.111595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54818 (local address 127.18.174.193:38747)
0812 11:08:44.120619 (+ 9024us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:44.120627 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:44.120652 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:08:44.120734 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:44.120740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:44.120967 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:44.121115 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:08:44.121522 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.122597 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.125104 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.125931 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.126054 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:44.126196 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:44.126991 (+ 795us) server_negotiation.cc:299] Negotiation successful
0812 11:08:44.127113 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8909,"thread_start_us":119,"threads_started":1}
I20260812 11:08:44.130192 10592 tablet_service.cc:1467] Processing CreateTablet for tablet f8938d5b7be14ba5bd8ebf962f2f4c47 (DEFAULT_TABLE table=test-table [id=6114340c24594dda9bdbb9561b23ff68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:08:44.130846 11229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:44.109641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:43635 (local address 127.0.0.1:45310)
0812 11:08:44.112031 (+ 2390us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:44.112131 (+ 100us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:44.112292 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:44.113678 (+ 1386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:44.113687 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:44.114712 (+ 1025us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:08:44.114909 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:44.114918 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.122754 (+ 7836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.122758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:44.124965 (+ 2207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:44.124975 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.127816 (+ 2841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.127820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:44.127908 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:44.127932 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:08:44.127999 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:08:44.128075 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2158,"mutex_wait_us":1112,"thread_start_us":122,"threads_started":1}
I20260812 11:08:44.131359 10592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8938d5b7be14ba5bd8ebf962f2f4c47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:08:44.131388 11233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:44.110540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43632 (local address 127.18.174.195:45589)
0812 11:08:44.113573 (+ 3033us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:44.113581 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:44.115389 (+ 1808us) server_negotiation.cc:407] Connection header received
0812 11:08:44.115487 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:44.115495 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:44.115729 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:44.116044 (+ 315us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:08:44.118749 (+ 2705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.119981 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.123266 (+ 3285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.124195 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.124320 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:44.124481 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:44.131090 (+ 6609us) server_negotiation.cc:299] Negotiation successful
0812 11:08:44.131230 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2911,"thread_start_us":116,"threads_started":1}
I20260812 11:08:44.134665 11070 tablet_service.cc:1467] Processing CreateTablet for tablet f8938d5b7be14ba5bd8ebf962f2f4c47 (DEFAULT_TABLE table=test-table [id=6114340c24594dda9bdbb9561b23ff68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:08:44.135951 11070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8938d5b7be14ba5bd8ebf962f2f4c47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:08:44.144548 11232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:44.110540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45310 (local address 127.18.174.194:43635)
0812 11:08:44.112623 (+ 2083us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:44.112631 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:44.112661 (+ 30us) server_negotiation.cc:407] Connection header received
0812 11:08:44.112755 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:44.112761 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:44.113031 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:44.113207 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:08:44.116176 (+ 2969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.122634 (+ 6458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.125554 (+ 2920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.127467 (+ 1913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.127597 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:44.127737 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:44.144204 (+ 16467us) server_negotiation.cc:299] Negotiation successful
0812 11:08:44.144374 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1952,"thread_start_us":96,"threads_started":1}
I20260812 11:08:44.147773 10825 tablet_service.cc:1467] Processing CreateTablet for tablet f8938d5b7be14ba5bd8ebf962f2f4c47 (DEFAULT_TABLE table=test-table [id=6114340c24594dda9bdbb9561b23ff68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:08:44.148515 11241 tablet_bootstrap.cc:492] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c: Bootstrap starting.
I20260812 11:08:44.149073 10825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8938d5b7be14ba5bd8ebf962f2f4c47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:08:44.157680 11241 tablet_bootstrap.cc:654] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c: Neither blocks nor log segments found. Creating new log.
I20260812 11:08:44.158706 11241 log.cc:824] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:44.159606 11240 tablet_bootstrap.cc:492] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 5ff0c12f0d384885b9a106d0e8886dcb: Bootstrap starting.
I20260812 11:08:44.162242 11240 tablet_bootstrap.cc:654] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 5ff0c12f0d384885b9a106d0e8886dcb: Neither blocks nor log segments found. Creating new log.
I20260812 11:08:44.163223 11240 log.cc:824] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 5ff0c12f0d384885b9a106d0e8886dcb: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:44.166394 11240 tablet_bootstrap.cc:492] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 5ff0c12f0d384885b9a106d0e8886dcb: No bootstrap required, opened a new log
I20260812 11:08:44.166687 11240 ts_tablet_manager.cc:1397] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 5ff0c12f0d384885b9a106d0e8886dcb: Time spent bootstrapping tablet: real 0.007s user 0.007s sys 0.000s
I20260812 11:08:44.168027 11243 tablet_bootstrap.cc:492] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 100bf760b62d4d80ae5dff627a6f8ca9: Bootstrap starting.
I20260812 11:08:44.169695 11241 tablet_bootstrap.cc:492] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c: No bootstrap required, opened a new log
I20260812 11:08:44.169951 11241 ts_tablet_manager.cc:1397] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260812 11:08:44.170684 11243 tablet_bootstrap.cc:654] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 100bf760b62d4d80ae5dff627a6f8ca9: Neither blocks nor log segments found. Creating new log.
I20260812 11:08:44.174131 11241 raft_consensus.cc:348] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf760b62d4d80ae5dff627a6f8ca9" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43635 } } peers { permanent_uuid: "1e01e0a3e3f2499eaf80d842cc59041c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45589 } } peers { permanent_uuid: "5ff0c12f0d384885b9a106d0e8886dcb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38747 } }
I20260812 11:08:44.174459 11241 raft_consensus.cc:374] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:08:44.174697 11243 log.cc:824] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 100bf760b62d4d80ae5dff627a6f8ca9: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:44.177495 11241 raft_consensus.cc:729] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e01e0a3e3f2499eaf80d842cc59041c, State: Initialized, Role: FOLLOWER
I20260812 11:08:44.178236 11241 consensus_queue.cc:260] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf760b62d4d80ae5dff627a6f8ca9" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43635 } } peers { permanent_uuid: "1e01e0a3e3f2499eaf80d842cc59041c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45589 } } peers { permanent_uuid: "5ff0c12f0d384885b9a106d0e8886dcb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38747 } }
I20260812 11:08:44.179036 11240 raft_consensus.cc:348] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 5ff0c12f0d384885b9a106d0e8886dcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf760b62d4d80ae5dff627a6f8ca9" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43635 } } peers { permanent_uuid: "1e01e0a3e3f2499eaf80d842cc59041c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45589 } } peers { permanent_uuid: "5ff0c12f0d384885b9a106d0e8886dcb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38747 } }
I20260812 11:08:44.179363 11240 raft_consensus.cc:374] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 5ff0c12f0d384885b9a106d0e8886dcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:08:44.179441 11240 raft_consensus.cc:729] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 5ff0c12f0d384885b9a106d0e8886dcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff0c12f0d384885b9a106d0e8886dcb, State: Initialized, Role: FOLLOWER
I20260812 11:08:44.179564 11241 ts_tablet_manager.cc:1428] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260812 11:08:44.179926 11240 consensus_queue.cc:260] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 5ff0c12f0d384885b9a106d0e8886dcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf760b62d4d80ae5dff627a6f8ca9" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43635 } } peers { permanent_uuid: "1e01e0a3e3f2499eaf80d842cc59041c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45589 } } peers { permanent_uuid: "5ff0c12f0d384885b9a106d0e8886dcb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38747 } }
I20260812 11:08:44.180038 11191 heartbeater.cc:503] Master 127.18.174.254:45675 was elected leader, sending a full tablet report...
I20260812 11:08:44.181062 11240 ts_tablet_manager.cc:1428] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 5ff0c12f0d384885b9a106d0e8886dcb: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260812 11:08:44.181455 10707 heartbeater.cc:503] Master 127.18.174.254:45675 was elected leader, sending a full tablet report...
I20260812 11:08:44.184053 11243 tablet_bootstrap.cc:492] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 100bf760b62d4d80ae5dff627a6f8ca9: No bootstrap required, opened a new log
I20260812 11:08:44.184409 11243 ts_tablet_manager.cc:1397] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 100bf760b62d4d80ae5dff627a6f8ca9: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.002s
I20260812 11:08:44.188596 11243 raft_consensus.cc:348] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 100bf760b62d4d80ae5dff627a6f8ca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf760b62d4d80ae5dff627a6f8ca9" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43635 } } peers { permanent_uuid: "1e01e0a3e3f2499eaf80d842cc59041c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45589 } } peers { permanent_uuid: "5ff0c12f0d384885b9a106d0e8886dcb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38747 } }
I20260812 11:08:44.188954 11243 raft_consensus.cc:374] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 100bf760b62d4d80ae5dff627a6f8ca9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:08:44.189021 11243 raft_consensus.cc:729] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 100bf760b62d4d80ae5dff627a6f8ca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 100bf760b62d4d80ae5dff627a6f8ca9, State: Initialized, Role: FOLLOWER
I20260812 11:08:44.189533 11243 consensus_queue.cc:260] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 100bf760b62d4d80ae5dff627a6f8ca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf760b62d4d80ae5dff627a6f8ca9" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43635 } } peers { permanent_uuid: "1e01e0a3e3f2499eaf80d842cc59041c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45589 } } peers { permanent_uuid: "5ff0c12f0d384885b9a106d0e8886dcb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38747 } }
I20260812 11:08:44.190310 10949 heartbeater.cc:503] Master 127.18.174.254:45675 was elected leader, sending a full tablet report...
I20260812 11:08:44.190795 11243 ts_tablet_manager.cc:1428] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 100bf760b62d4d80ae5dff627a6f8ca9: Time spent starting tablet: real 0.006s user 0.004s sys 0.002s
W20260812 11:08:44.230492 10950 tablet.cc:2369] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 100bf760b62d4d80ae5dff627a6f8ca9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:08:44.266480 11192 tablet.cc:2369] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:08:44.325373 11250 raft_consensus.cc:482] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:08:44.325608 11250 raft_consensus.cc:504] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf760b62d4d80ae5dff627a6f8ca9" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43635 } } peers { permanent_uuid: "1e01e0a3e3f2499eaf80d842cc59041c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45589 } } peers { permanent_uuid: "5ff0c12f0d384885b9a106d0e8886dcb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38747 } }
I20260812 11:08:44.327163 11250 leader_election.cc:288] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 100bf760b62d4d80ae5dff627a6f8ca9 (127.18.174.194:43635), 5ff0c12f0d384885b9a106d0e8886dcb (127.18.174.193:38747)
I20260812 11:08:44.333454 11238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:44.328184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:56619 (local address 127.18.174.193:38747)
0812 11:08:44.328368 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:44.328374 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:44.328956 (+ 582us) server_negotiation.cc:407] Connection header received
0812 11:08:44.329179 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:44.329183 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:44.329232 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:44.329278 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:08:44.329751 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.330504 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.332174 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.332749 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.332848 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:44.332915 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:44.333238 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 11:08:44.333318 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:08:44.333989 11260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:44.327684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:38747 (local address 127.18.174.195:56619)
0812 11:08:44.328843 (+ 1159us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:44.328858 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:44.329051 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:44.329446 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:44.329449 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:44.329468 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:08:44.329617 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:44.329624 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.330675 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.330678 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:44.332002 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:44.332016 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.333014 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.333017 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:44.333113 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:44.333136 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:08:44.333748 (+ 612us) client_negotiation.cc:240] Negotiation successful
0812 11:08:44.333828 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1087,"thread_start_us":136,"threads_started":1}
I20260812 11:08:44.334939 10626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8938d5b7be14ba5bd8ebf962f2f4c47" candidate_uuid: "1e01e0a3e3f2499eaf80d842cc59041c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff0c12f0d384885b9a106d0e8886dcb" is_pre_election: true
I20260812 11:08:44.335340 10626 raft_consensus.cc:2454] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 5ff0c12f0d384885b9a106d0e8886dcb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e01e0a3e3f2499eaf80d842cc59041c in term 0.
I20260812 11:08:44.336043 10992 leader_election.cc:302] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e01e0a3e3f2499eaf80d842cc59041c, 5ff0c12f0d384885b9a106d0e8886dcb; no voters:
I20260812 11:08:44.336422 11250 raft_consensus.cc:2781] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:08:44.336501 11250 raft_consensus.cc:482] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:08:44.336537 11250 raft_consensus.cc:3037] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:08:44.337908 11250 raft_consensus.cc:504] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf760b62d4d80ae5dff627a6f8ca9" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43635 } } peers { permanent_uuid: "1e01e0a3e3f2499eaf80d842cc59041c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45589 } } peers { permanent_uuid: "5ff0c12f0d384885b9a106d0e8886dcb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38747 } }
I20260812 11:08:44.338320 11250 leader_election.cc:288] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [CANDIDATE]: Term 1 election: Requested vote from peers 100bf760b62d4d80ae5dff627a6f8ca9 (127.18.174.194:43635), 5ff0c12f0d384885b9a106d0e8886dcb (127.18.174.193:38747)
I20260812 11:08:44.339007 10626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8938d5b7be14ba5bd8ebf962f2f4c47" candidate_uuid: "1e01e0a3e3f2499eaf80d842cc59041c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff0c12f0d384885b9a106d0e8886dcb"
I20260812 11:08:44.339154 10626 raft_consensus.cc:3037] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 5ff0c12f0d384885b9a106d0e8886dcb [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:08:44.339829 11232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:44.328607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:60309 (local address 127.18.174.194:43635)
0812 11:08:44.328726 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:44.328730 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:44.330308 (+ 1578us) server_negotiation.cc:407] Connection header received
0812 11:08:44.330523 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:44.330527 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:44.330581 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:44.330631 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:08:44.331118 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.331873 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.333438 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.334060 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.334157 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:44.334207 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:44.339580 (+ 5373us) server_negotiation.cc:299] Negotiation successful
0812 11:08:44.339695 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:08:44.340665 11262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:44.328474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:43635 (local address 127.18.174.195:60309)
0812 11:08:44.330197 (+ 1723us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:44.330212 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:44.330389 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:44.330812 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:44.330815 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:44.330836 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:08:44.330972 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:44.330980 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.332028 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.332031 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:44.333235 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:44.333248 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.339211 (+ 5963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.339216 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:44.339373 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:44.339409 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:08:44.340060 (+ 651us) client_negotiation.cc:240] Negotiation successful
0812 11:08:44.340187 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1648,"thread_start_us":108,"threads_started":1}
I20260812 11:08:44.340945 10626 raft_consensus.cc:2454] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 5ff0c12f0d384885b9a106d0e8886dcb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e01e0a3e3f2499eaf80d842cc59041c in term 1.
I20260812 11:08:44.341475 10865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8938d5b7be14ba5bd8ebf962f2f4c47" candidate_uuid: "1e01e0a3e3f2499eaf80d842cc59041c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "100bf760b62d4d80ae5dff627a6f8ca9" is_pre_election: true
I20260812 11:08:44.341602 10992 leader_election.cc:302] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e01e0a3e3f2499eaf80d842cc59041c, 5ff0c12f0d384885b9a106d0e8886dcb; no voters:
I20260812 11:08:44.341877 10865 raft_consensus.cc:2454] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 100bf760b62d4d80ae5dff627a6f8ca9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e01e0a3e3f2499eaf80d842cc59041c in term 0.
I20260812 11:08:44.341912 11250 raft_consensus.cc:2781] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:08:44.341536 10863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8938d5b7be14ba5bd8ebf962f2f4c47" candidate_uuid: "1e01e0a3e3f2499eaf80d842cc59041c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "100bf760b62d4d80ae5dff627a6f8ca9"
I20260812 11:08:44.342141 11250 raft_consensus.cc:686] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [term 1 LEADER]: Becoming Leader. State: Replica: 1e01e0a3e3f2499eaf80d842cc59041c, State: Running, Role: LEADER
I20260812 11:08:44.342185 10863 raft_consensus.cc:3037] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 100bf760b62d4d80ae5dff627a6f8ca9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:08:44.342566 11250 consensus_queue.cc:237] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf760b62d4d80ae5dff627a6f8ca9" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43635 } } peers { permanent_uuid: "1e01e0a3e3f2499eaf80d842cc59041c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45589 } } peers { permanent_uuid: "5ff0c12f0d384885b9a106d0e8886dcb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38747 } }
I20260812 11:08:44.343593 10863 raft_consensus.cc:2454] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 100bf760b62d4d80ae5dff627a6f8ca9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e01e0a3e3f2499eaf80d842cc59041c in term 1.
I20260812 11:08:44.347405 10378 catalog_manager.cc:5495] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e01e0a3e3f2499eaf80d842cc59041c (127.18.174.195). New cstate: current_term: 1 leader_uuid: "1e01e0a3e3f2499eaf80d842cc59041c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf760b62d4d80ae5dff627a6f8ca9" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e01e0a3e3f2499eaf80d842cc59041c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff0c12f0d384885b9a106d0e8886dcb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38747 } health_report { overall_health: UNKNOWN } } }
Aug 12 11:08:44 dist-test-slave-lgr5 krb5kdc[8590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532923, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for HTTP/127.18.174.212@KRBTEST.COM
I20260812 11:08:44.413640 11233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:44.408243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43646 (local address 127.18.174.195:45589)
0812 11:08:44.408368 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:44.408373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:44.408387 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:08:44.408513 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:44.408515 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:44.408574 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:44.408679 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:08:44.409017 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.409771 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.411032 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:44.411377 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:44.411488 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:44.411996 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:08:44.412657 (+ 661us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:08:44.412787 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:44.413415 (+ 628us) server_negotiation.cc:299] Negotiation successful
0812 11:08:44.413494 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260812 11:08:44.417797 10710 tablet.cc:2369] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 5ff0c12f0d384885b9a106d0e8886dcb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:08:44.423249 10626 raft_consensus.cc:1261] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 5ff0c12f0d384885b9a106d0e8886dcb [term 1 FOLLOWER]: Refusing update from remote peer 1e01e0a3e3f2499eaf80d842cc59041c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:08:44.424242 11250 consensus_queue.cc:1035] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff0c12f0d384885b9a106d0e8886dcb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 38747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:08:44.433059 10863 raft_consensus.cc:1261] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 100bf760b62d4d80ae5dff627a6f8ca9 [term 1 FOLLOWER]: Refusing update from remote peer 1e01e0a3e3f2499eaf80d842cc59041c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:08:44.434062 11250 consensus_queue.cc:1035] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [LEADER]: Connected to new peer: Peer: permanent_uuid: "100bf760b62d4d80ae5dff627a6f8ca9" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 43635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:08:44.450534 11272 mvcc.cc:205] Tried to move back new op lower bound from 7317638858427703296 to 7317638858111250432. Current Snapshot: MvccSnapshot[applied={T|T < 7317638858427703296}]
I20260812 11:08:44.452924 11276 mvcc.cc:205] Tried to move back new op lower bound from 7317638858427703296 to 7317638858111250432. Current Snapshot: MvccSnapshot[applied={T|T < 7317638858427703296}]
I20260812 11:08:44.466586 11273 mvcc.cc:205] Tried to move back new op lower bound from 7317638858427703296 to 7317638858111250432. Current Snapshot: MvccSnapshot[applied={T|T < 7317638858427703296}]
I20260812 11:08:44.478266 10377 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:08:44.478505 10377 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:08:44.481742 10377 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c9408660651a4e9ab70446a68acf65b8: Sending DeleteTablet for 3 replicas of tablet f8938d5b7be14ba5bd8ebf962f2f4c47
I20260812 11:08:44.483522 10825 tablet_service.cc:1514] Processing DeleteTablet for tablet f8938d5b7be14ba5bd8ebf962f2f4c47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:08:44 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:45310
I20260812 11:08:44.484297 10592 tablet_service.cc:1514] Processing DeleteTablet for tablet f8938d5b7be14ba5bd8ebf962f2f4c47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:08:44 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:54818
I20260812 11:08:44.484849 11070 tablet_service.cc:1514] Processing DeleteTablet for tablet f8938d5b7be14ba5bd8ebf962f2f4c47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:08:44 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:43632
I20260812 11:08:44.486322 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 10442
I20260812 11:08:44.498817 11294 tablet_replica.cc:330] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c: stopping tablet replica
I20260812 11:08:44.499362 11294 raft_consensus.cc:2229] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:08:44.499974 11294 raft_consensus.cc:2258] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:08:44.501880 11294 ts_tablet_manager.cc:1905] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:08:44.505527 11294 ts_tablet_manager.cc:1918] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:08:44.505730 11294 log.cc:1196] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/f8938d5b7be14ba5bd8ebf962f2f4c47
I20260812 11:08:44.506167 11294 ts_tablet_manager.cc:1939] T f8938d5b7be14ba5bd8ebf962f2f4c47 P 1e01e0a3e3f2499eaf80d842cc59041c: Deleting consensus metadata
W20260812 11:08:44.507354 10355 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:38747 (error 108)
I20260812 11:08:44.508579 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 10712
I20260812 11:08:44.532752 10355 catalog_manager.cc:4841] TS 1e01e0a3e3f2499eaf80d842cc59041c (127.18.174.195:45589): tablet f8938d5b7be14ba5bd8ebf962f2f4c47 (table test-table [id=6114340c24594dda9bdbb9561b23ff68]) successfully deleted
I20260812 11:08:44.580471 11226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:44.580021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:38747 (local address 127.0.0.1:54828)
0812 11:08:44.580272 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:44.580364 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:38747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
W20260812 11:08:44.580719 10355 catalog_manager.cc:4584] TS 5ff0c12f0d384885b9a106d0e8886dcb (127.18.174.193:38747): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f8938d5b7be14ba5bd8ebf962f2f4c47: Network error: Client connection negotiation failed: client connection to 127.18.174.193:38747: connect: Connection refused (error 111)
I20260812 11:08:44.604277 11226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:44.603854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:43635 (local address 127.0.0.1:45316)
0812 11:08:44.604073 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:44.604165 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.194:43635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260812 11:08:44.604866 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 10955
I20260812 11:08:44.623870 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 10330
I20260812 11:08:44.651728 19131 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 11:08:44.997303 19131 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 11:08:44.997442 19131 mini_ranger.cc:66] Stopping Ranger...
I20260812 11:08:45.342975 19131 mini_ranger.cc:68] Stopped Ranger
2026-08-12 11:08:45.343 UTC [8648] LOG: received smart shutdown request
2026-08-12 11:08:45.348 UTC [8648] LOG: background worker "logical replication launcher" (PID 8663) exited with exit code 1
2026-08-12 11:08:45.348 UTC [8654] LOG: shutting down
2026-08-12 11:08:45.534 UTC [8648] LOG: database system is shut down
2026-08-12T11:08:45Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52610 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:08:45 dist-test-slave-lgr5 krb5kdc[11316](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:08:45 dist-test-slave-lgr5 krb5kdc[11316](info): set up 2 sockets
Aug 12 11:08:45 dist-test-slave-lgr5 krb5kdc[11316](info): commencing operation
krb5kdc: starting...
W20260812 11:08:46.825001 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:08:46 dist-test-slave-lgr5 krb5kdc[11316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:08:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:08:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:08:46.959713 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:41331
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:41331,127.18.174.253:38831,127.18.174.252:36963
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:08:47.077735 11333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:47.078040 11333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:47.078101 11333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:47.082314 11333 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:08:47.082398 11333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:47.082428 11333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:47.082451 11333 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:08:47.082482 11333 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:08:47.088201 11333 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:41331,127.18.174.253:38831,127.18.174.252:36963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:41331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:47.089394 11333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:47.090476 11333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:47.099383 11348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:47.099401 11346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:47.099416 11344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:47.099743 11333 server_base.cc:1034] running on GCE node
I20260812 11:08:47.100445 11333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:47.101653 11333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:47.102877 11333 hybrid_clock.cc:648] HybridClock initialized: now 1786532927102849 us; error 41 us; skew 500 ppm
Aug 12 11:08:47 dist-test-slave-lgr5 krb5kdc[11316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532927, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:47.116484 11333 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:08:47.117664 11333 webserver.cc:460] Webserver started at http://127.18.174.254:34423/ using document root <none> and password file <none>
I20260812 11:08:47.118281 11333 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:47.118355 11333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:47.118557 11333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:08:47.120952 11333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "a9b4453d82bb4e5882b9d13f3aa29874"
format_stamp: "Formatted at 2026-08-12 11:08:47 on dist-test-slave-lgr5"
server_key: "2e40c22b43c6231ff6b91b16dc6120c7"
server_key_iv: "3348fad65d2b4afbc2a844c45640565d"
server_key_version: "encryptionkey@0"
I20260812 11:08:47.121557 11333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "a9b4453d82bb4e5882b9d13f3aa29874"
format_stamp: "Formatted at 2026-08-12 11:08:47 on dist-test-slave-lgr5"
server_key: "2e40c22b43c6231ff6b91b16dc6120c7"
server_key_iv: "3348fad65d2b4afbc2a844c45640565d"
server_key_version: "encryptionkey@0"
I20260812 11:08:47.125813 11333 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:08:47.128621 11358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:47.130069 11333 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:08:47.130193 11333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "a9b4453d82bb4e5882b9d13f3aa29874"
format_stamp: "Formatted at 2026-08-12 11:08:47 on dist-test-slave-lgr5"
server_key: "2e40c22b43c6231ff6b91b16dc6120c7"
server_key_iv: "3348fad65d2b4afbc2a844c45640565d"
server_key_version: "encryptionkey@0"
I20260812 11:08:47.130298 11333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:47.147980 11333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:47.151515 11333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:47.151686 11333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:47.159224 11333 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:41331
I20260812 11:08:47.159533 11433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:41331 every 8 connection(s)
I20260812 11:08:47.160409 11333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:08:47.163656 11435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:08:47.168121 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 11333
I20260812 11:08:47.168248 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:08:47.167972 11435 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:08:47.168578 19131 external_mini_cluster.cc:1428] Setting key 046ae80169ec0935dc93313cf64b0aed
WARNING: no policy specified for kudu/127.18.174.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.253@KRBTEST.COM" created.
Aug 12 11:08:47 dist-test-slave-lgr5 krb5kdc[11316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532927, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:47.186535 11441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.171060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:41331 (local address 127.0.0.1:46164)
0812 11:08:47.171690 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.171739 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:47.172739 (+ 1000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:47.173447 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:47.173452 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:47.173920 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:47.174200 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.174216 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.175375 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.175377 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.176183 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.176194 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.176839 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.176843 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.176935 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.177593 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:47.177610 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:47.181287 (+ 3677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:47.183278 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.183288 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.183301 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.183549 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.183879 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.183882 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.183884 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.184006 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.184730 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:47.184737 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:47.184896 (+ 159us) client_negotiation.cc:769] Sending connection context
0812 11:08:47.185053 (+ 157us) client_negotiation.cc:240] Negotiation successful
0812 11:08:47.185467 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":104,"spinlock_wait_cycles":896,"thread_start_us":187,"threads_started":1}
I20260812 11:08:47.186535 11442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.172252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46164 (local address 127.18.174.254:41331)
0812 11:08:47.172588 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:47.172600 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:47.172651 (+ 51us) server_negotiation.cc:407] Connection header received
0812 11:08:47.173052 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:47.173057 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:47.173254 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:47.173427 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:47.174353 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.175250 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.176295 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.176687 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.176839 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.181454 (+ 4615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:47.181462 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:47.181476 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:47.181504 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:47.183157 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.183668 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.183674 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.183675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.183790 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.184122 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.184124 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.184126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.184609 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:47.184748 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:47.185152 (+ 404us) server_negotiation.cc:299] Negotiation successful
0812 11:08:47.185402 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":107,"threads_started":1}
I20260812 11:08:47.189605 11435 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:08:47.190397 11441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.190116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38831 (local address 127.0.0.1:49978)
0812 11:08:47.190244 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.190323 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 11:08:47.190641 11360 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38831: connect: Connection refused (error 111)
I20260812 11:08:47.191535 11441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.191299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38831 (local address 127.0.0.1:49984)
0812 11:08:47.191406 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.191452 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 11:08:47.191720 11435 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.253:38831: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38831: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.253.keytab.
Entry for principal kudu/127.18.174.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.253.keytab.
I20260812 11:08:47.198899 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.253:38831
--webserver_interface=127.18.174.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.253.keytab
--principal=kudu/127.18.174.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:41331,127.18.174.253:38831,127.18.174.252:36963
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:08:47.241014 11435 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } attempt: 1
I20260812 11:08:47.242035 11441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.241677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38831 (local address 127.0.0.1:49998)
0812 11:08:47.241868 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.241946 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260812 11:08:47.242874 11441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.242637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38831 (local address 127.0.0.1:50002)
0812 11:08:47.242750 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.242802 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 11:08:47.243033 11435 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.253:38831: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38831: connect: Connection refused (error 111)
I20260812 11:08:47.311234 11435 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } attempt: 2
I20260812 11:08:47.312198 11441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.311778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38831 (local address 127.0.0.1:50012)
0812 11:08:47.311954 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.312097 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260812 11:08:47.315510 11441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.312734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38831 (local address 127.0.0.1:50018)
0812 11:08:47.315341 (+ 2607us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.315409 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2540,"thread_start_us":2346,"threads_started":1}
W20260812 11:08:47.317422 11435 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.253:38831: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38831: connect: Connection refused (error 111)
W20260812 11:08:47.326288 11446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:47.326679 11446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:47.326745 11446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:47.331297 11446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:08:47.331393 11446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:47.331423 11446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:47.331451 11446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:08:47.331470 11446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:08:47.338512 11446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:41331,127.18.174.253:38831,127.18.174.252:36963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.253.keytab
--principal=kudu/127.18.174.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.253:38831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.174.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:47.341461 11446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:47.344735 11446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:47.355424 11460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:47.355414 11458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:47.355414 11454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:47.361498 11446 server_base.cc:1034] running on GCE node
I20260812 11:08:47.362166 11446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:47.363404 11446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:47.364643 11446 hybrid_clock.cc:648] HybridClock initialized: now 1786532927364591 us; error 62 us; skew 500 ppm
Aug 12 11:08:47 dist-test-slave-lgr5 krb5kdc[11316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532927, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:47.367729 11446 init.cc:377] Logged in from keytab as kudu/127.18.174.253@KRBTEST.COM (short username kudu)
I20260812 11:08:47.368853 11446 webserver.cc:460] Webserver started at http://127.18.174.253:42499/ using document root <none> and password file <none>
I20260812 11:08:47.369451 11446 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:47.369524 11446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:47.369750 11446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:08:47.371913 11446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/data/instance:
uuid: "91ca01c12f0c457da3e49ae33883302f"
format_stamp: "Formatted at 2026-08-12 11:08:47 on dist-test-slave-lgr5"
server_key: "3604836aa442c5251e5411bdc73ed45b"
server_key_iv: "df6cea46eb081d0061a5fee3285a44dc"
server_key_version: "encryptionkey@0"
I20260812 11:08:47.372527 11446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/wal/instance:
uuid: "91ca01c12f0c457da3e49ae33883302f"
format_stamp: "Formatted at 2026-08-12 11:08:47 on dist-test-slave-lgr5"
server_key: "3604836aa442c5251e5411bdc73ed45b"
server_key_iv: "df6cea46eb081d0061a5fee3285a44dc"
server_key_version: "encryptionkey@0"
I20260812 11:08:47.376544 11446 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:08:47.379083 11475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:47.380534 11446 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:08:47.380682 11446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/wal
uuid: "91ca01c12f0c457da3e49ae33883302f"
format_stamp: "Formatted at 2026-08-12 11:08:47 on dist-test-slave-lgr5"
server_key: "3604836aa442c5251e5411bdc73ed45b"
server_key_iv: "df6cea46eb081d0061a5fee3285a44dc"
server_key_version: "encryptionkey@0"
I20260812 11:08:47.380793 11446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:47.405053 11446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:47.408124 11446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:47.408314 11446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:47.408599 11435 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } attempt: 3
I20260812 11:08:47.409521 11447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.409088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38831 (local address 127.0.0.1:50028)
0812 11:08:47.409268 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.409344 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260812 11:08:47.410393 11447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.410110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38831 (local address 127.0.0.1:50038)
0812 11:08:47.410264 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.410321 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260812 11:08:47.410533 11435 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.253:38831: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38831: connect: Connection refused (error 111)
I20260812 11:08:47.415750 11446 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.253:38831
I20260812 11:08:47.416021 11560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.253:38831 every 8 connection(s)
I20260812 11:08:47.416818 11446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/data/info.pb
I20260812 11:08:47.420064 11561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:08:47.424393 11561 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:08:47.426999 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 11446
I20260812 11:08:47.427109 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-1/wal/instance
I20260812 11:08:47.427380 19131 external_mini_cluster.cc:1428] Setting key 1c2ea9408e68ef0f347e3b97ed14fe71
Aug 12 11:08:47 dist-test-slave-lgr5 krb5kdc[11316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532927, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.253@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.174.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.252@KRBTEST.COM" created.
I20260812 11:08:47.440704 11442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.426519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46170 (local address 127.18.174.254:41331)
0812 11:08:47.426688 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:47.426693 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:47.427699 (+ 1006us) server_negotiation.cc:407] Connection header received
0812 11:08:47.428786 (+ 1087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:47.428790 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:47.428857 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:47.428967 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:47.430663 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.431204 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.433031 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.433293 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.433417 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.436697 (+ 3280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:47.436701 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:47.436703 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:47.436738 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:47.438176 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.438798 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.438802 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.438803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.438943 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.439355 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.439358 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.439359 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.439580 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:47.439672 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:47.440435 (+ 763us) server_negotiation.cc:299] Negotiation successful
0812 11:08:47.440571 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 11:08:47.441835 11568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.426918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:41331 (local address 127.0.0.1:46170)
0812 11:08:47.427512 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.427572 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:47.428536 (+ 964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:47.429179 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:47.429189 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:47.429733 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:47.430458 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.430493 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.431356 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.431360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.432862 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.432879 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.433502 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.433507 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.433778 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.434510 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:47.434534 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:47.436455 (+ 1921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:47.438356 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.438362 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.438378 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.438684 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.439045 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.439049 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.439051 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.439213 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.439699 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:47.439707 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:47.440114 (+ 407us) client_negotiation.cc:769] Sending connection context
0812 11:08:47.440351 (+ 237us) client_negotiation.cc:240] Negotiation successful
0812 11:08:47.440744 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":177,"threads_started":1}
I20260812 11:08:47.443606 11561 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:08:47 dist-test-slave-lgr5 krb5kdc[11316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532927, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.253@KRBTEST.COM for kudu/127.18.174.253@KRBTEST.COM
I20260812 11:08:47.455996 11568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.444205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38831 (local address 127.0.0.1:50050)
0812 11:08:47.444331 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.444345 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:47.444432 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:47.445145 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:47.445148 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:47.445290 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:47.445404 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.445410 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.446797 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.446799 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.447346 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.447355 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.448200 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.448203 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.448282 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.448797 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:47.448809 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:47.452335 (+ 3526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:47.454408 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.454411 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.454413 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.454663 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.454931 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.454933 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.454934 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.455025 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.455510 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:47.455512 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:47.455606 (+ 94us) client_negotiation.cc:769] Sending connection context
0812 11:08:47.455695 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 11:08:47.455813 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 11:08:47.456192 11579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.444286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50050 (local address 127.18.174.253:38831)
0812 11:08:47.444690 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:47.444702 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:47.444728 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:08:47.444776 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:47.444782 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:47.445016 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:47.445161 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:47.445518 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.446684 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.447463 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.448057 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.448205 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.452492 (+ 4287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:47.452505 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:47.452519 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:47.452546 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:47.454291 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.454778 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.454783 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.454784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.454861 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.455093 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.455094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.455096 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.455412 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:47.455540 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:47.455777 (+ 237us) server_negotiation.cc:299] Negotiation successful
0812 11:08:47.455916 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":180,"threads_started":1}
I20260812 11:08:47.458127 11561 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:08:47.458891 11568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.458579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:36963 (local address 127.0.0.1:56556)
0812 11:08:47.458691 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.458806 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.252.keytab.
Entry for principal kudu/127.18.174.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.252.keytab.
W20260812 11:08:47.459085 11476 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
I20260812 11:08:47.459987 11568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.459762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:36963 (local address 127.0.0.1:56566)
0812 11:08:47.459870 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.459917 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 11:08:47.459964 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.252:36963
--webserver_interface=127.18.174.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.252.keytab
--principal=kudu/127.18.174.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:41331,127.18.174.253:38831,127.18.174.252:36963
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:08:47.460153 11561 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:36963: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
I20260812 11:08:47.509444 11561 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } attempt: 1
I20260812 11:08:47.510463 11568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.510062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:36963 (local address 127.0.0.1:56572)
0812 11:08:47.510267 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.510356 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 11:08:47.511284 11568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.511032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:36963 (local address 127.0.0.1:56578)
0812 11:08:47.511168 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.511221 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260812 11:08:47.511430 11561 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:36963: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
I20260812 11:08:47.553707 11435 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } attempt: 4
Aug 12 11:08:47 dist-test-slave-lgr5 krb5kdc[11316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532927, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for kudu/127.18.174.253@KRBTEST.COM
I20260812 11:08:47.564766 11447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.554395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38831 (local address 127.0.0.1:50060)
0812 11:08:47.554590 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.554609 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:47.554732 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:47.555059 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:47.555062 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:47.555266 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:47.555818 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.555831 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.556949 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.556953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.557558 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.557568 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.559083 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.559089 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.559216 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.559732 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:47.559745 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:47.561310 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:47.563173 (+ 1863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.563175 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.563177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.563404 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.563739 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.563742 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.563743 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.563840 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.564306 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:47.564309 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:47.564406 (+ 97us) client_negotiation.cc:769] Sending connection context
0812 11:08:47.564497 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 11:08:47.564629 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91}
I20260812 11:08:47.564859 11579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.554467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50060 (local address 127.18.174.253:38831)
0812 11:08:47.554620 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:47.554625 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:47.554695 (+ 70us) server_negotiation.cc:407] Connection header received
0812 11:08:47.554855 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:47.554858 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:47.554915 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:47.555018 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:47.555971 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.556791 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.557687 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.558876 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.558996 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.561462 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:47.561466 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:47.561469 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:47.561499 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:47.563045 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.563504 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.563508 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.563510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.563606 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.563933 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.563936 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.563937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.564212 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:47.564314 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:47.564564 (+ 250us) server_negotiation.cc:299] Negotiation successful
0812 11:08:47.564694 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:08:47.565586 11435 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:08:47.566323 11447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.566062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:36963 (local address 127.0.0.1:56590)
0812 11:08:47.566190 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.566250 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 11:08:47.566905 11447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.566693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:36963 (local address 127.0.0.1:56606)
0812 11:08:47.566784 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.566835 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 11:08:47.567060 11435 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:36963: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
W20260812 11:08:47.579460 11584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
I20260812 11:08:47.579609 11561 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } attempt: 2
W20260812 11:08:47.579733 11584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:47.579777 11584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 11:08:47.580428 11568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.580132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:36963 (local address 127.0.0.1:56612)
0812 11:08:47.580268 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.580348 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 11:08:47.581326 11568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.581023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:36963 (local address 127.0.0.1:56626)
0812 11:08:47.581161 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.581220 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 11:08:47.581472 11561 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:36963: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
W20260812 11:08:47.584072 11584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:08:47.584161 11584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:47.584182 11584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:47.584205 11584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:08:47.584224 11584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:08:47.589856 11584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:41331,127.18.174.253:38831,127.18.174.252:36963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.252.keytab
--principal=kudu/127.18.174.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.252:36963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.174.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:47.591028 11584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:47.592073 11584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:47.600809 11595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:47.600876 11584 server_base.cc:1034] running on GCE node
W20260812 11:08:47.600802 11593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:47.600807 11590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:47.601688 11584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:47.602849 11584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:47.604046 11584 hybrid_clock.cc:648] HybridClock initialized: now 1786532927604020 us; error 34 us; skew 500 ppm
Aug 12 11:08:47 dist-test-slave-lgr5 krb5kdc[11316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532927, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:47.607025 11584 init.cc:377] Logged in from keytab as kudu/127.18.174.252@KRBTEST.COM (short username kudu)
I20260812 11:08:47.608183 11584 webserver.cc:460] Webserver started at http://127.18.174.252:46161/ using document root <none> and password file <none>
I20260812 11:08:47.608857 11584 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:47.608927 11584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:47.609109 11584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:08:47.611193 11584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/data/instance:
uuid: "fe2316f0d93847d19f4d9ddbef064a2c"
format_stamp: "Formatted at 2026-08-12 11:08:47 on dist-test-slave-lgr5"
server_key: "88bf1e5868f06219e885134e287443d6"
server_key_iv: "6e07440b12f357d027d1fab99a9375db"
server_key_version: "encryptionkey@0"
I20260812 11:08:47.611725 11584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/wal/instance:
uuid: "fe2316f0d93847d19f4d9ddbef064a2c"
format_stamp: "Formatted at 2026-08-12 11:08:47 on dist-test-slave-lgr5"
server_key: "88bf1e5868f06219e885134e287443d6"
server_key_iv: "6e07440b12f357d027d1fab99a9375db"
server_key_version: "encryptionkey@0"
I20260812 11:08:47.615621 11584 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:08:47.618566 11607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:47.620117 11584 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:08:47.620277 11584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/wal
uuid: "fe2316f0d93847d19f4d9ddbef064a2c"
format_stamp: "Formatted at 2026-08-12 11:08:47 on dist-test-slave-lgr5"
server_key: "88bf1e5868f06219e885134e287443d6"
server_key_iv: "6e07440b12f357d027d1fab99a9375db"
server_key_version: "encryptionkey@0"
I20260812 11:08:47.620402 11584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:47.626225 11435 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } attempt: 1
I20260812 11:08:47.627040 11447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.626743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:36963 (local address 127.0.0.1:56628)
0812 11:08:47.626887 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.626958 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 11:08:47.627851 11447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.627586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:36963 (local address 127.0.0.1:56632)
0812 11:08:47.627730 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.627785 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260812 11:08:47.628026 11435 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:36963: Network error: Client connection negotiation failed: client connection to 127.18.174.252:36963: connect: Connection refused (error 111)
I20260812 11:08:47.638598 11584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:47.642148 11584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:47.642339 11584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:47.649806 11584 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.252:36963
I20260812 11:08:47.649817 11698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.252:36963 every 8 connection(s)
I20260812 11:08:47.650913 11584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/data/info.pb
I20260812 11:08:47.654125 11701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:08:47.657383 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 11584
I20260812 11:08:47.657516 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532756485707-19131-0/minicluster-data/master-2/wal/instance
I20260812 11:08:47.657851 19131 external_mini_cluster.cc:1428] Setting key a295347242da4833c2af3964025e69fc
I20260812 11:08:47.658339 11701 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:08:47 dist-test-slave-lgr5 krb5kdc[11316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532927, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.252@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
Aug 12 11:08:47 dist-test-slave-lgr5 krb5kdc[11316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.252@KRBTEST.COM
I20260812 11:08:47.671584 11442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.660272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46178 (local address 127.18.174.254:41331)
0812 11:08:47.660408 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:47.660414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:47.660725 (+ 311us) server_negotiation.cc:407] Connection header received
0812 11:08:47.661100 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:47.661103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:47.661152 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:47.661230 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:47.662241 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.663011 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.664374 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.664716 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.664860 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.667737 (+ 2877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:47.667742 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:47.667744 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:47.667780 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:47.669346 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.669901 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.669905 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.669907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.670012 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.670410 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.670413 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.670415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.670643 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:47.670735 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:47.671283 (+ 548us) server_negotiation.cc:299] Negotiation successful
0812 11:08:47.671414 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:08:47.672524 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.660187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:41331 (local address 127.0.0.1:46178)
0812 11:08:47.660582 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.660632 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:47.660917 (+ 285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:47.661302 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:47.661307 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:47.661742 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:47.662109 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.662122 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.663108 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.663110 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.664230 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.664242 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.664884 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.664887 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.665114 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.665725 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:47.665749 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:47.667504 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:47.669457 (+ 1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.669466 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.669476 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.669792 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.670108 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.670111 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.670113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.670303 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.670752 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:47.670760 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:47.671042 (+ 282us) client_negotiation.cc:769] Sending connection context
0812 11:08:47.671224 (+ 182us) client_negotiation.cc:240] Negotiation successful
0812 11:08:47.671577 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":57,"spinlock_wait_cycles":768,"thread_start_us":149,"threads_started":1}
I20260812 11:08:47.672528 11705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.659325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56638 (local address 127.18.174.252:36963)
0812 11:08:47.659752 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:47.659767 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:47.659803 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:08:47.660622 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:47.660646 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:47.660940 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:47.661144 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:47.662062 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.663285 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.664459 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.665071 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.665148 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.668173 (+ 3025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:47.668179 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:47.668191 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:47.668214 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:47.669962 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.670518 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.670525 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.670527 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.670613 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.670870 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.670874 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.670875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.671133 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:47.671328 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:47.671539 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 11:08:47.672031 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":281,"spinlock_wait_cycles":2432,"thread_start_us":113,"threads_started":1}
I20260812 11:08:47.672648 11561 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } attempt: 3
I20260812 11:08:47.674018 11701 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:08:47 dist-test-slave-lgr5 krb5kdc[11316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532927, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.253@KRBTEST.COM for kudu/127.18.174.252@KRBTEST.COM
Aug 12 11:08:47 dist-test-slave-lgr5 krb5kdc[11316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532927, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.252@KRBTEST.COM for kudu/127.18.174.253@KRBTEST.COM
I20260812 11:08:47.681658 11568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.673120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:36963 (local address 127.0.0.1:56654)
0812 11:08:47.673325 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.673341 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:47.673426 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:47.673714 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:47.673718 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:47.673909 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:47.674021 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.674028 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.674923 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.674927 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.675698 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.675708 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.676307 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.676311 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.676406 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.676883 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:47.676895 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:47.678245 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:47.679991 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.679995 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.679997 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.680275 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.680572 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.680576 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.680578 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.680673 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.681119 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:47.681122 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:47.681218 (+ 96us) client_negotiation.cc:769] Sending connection context
0812 11:08:47.681306 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 11:08:47.681499 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122}
I20260812 11:08:47.681670 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.673216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56654 (local address 127.18.174.252:36963)
0812 11:08:47.673522 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:47.673530 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:47.673541 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:08:47.673571 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:47.673573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:47.673606 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:47.673674 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:47.674144 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.674786 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.675809 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.676204 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.676298 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.678378 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:47.678382 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:47.678385 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:47.678410 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:47.679873 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.680380 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.680384 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.680386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.680483 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.680784 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.680788 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.680789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.681021 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:47.681112 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:47.681370 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 11:08:47.681485 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":126,"threads_started":1}
Aug 12 11:08:47 dist-test-slave-lgr5 krb5kdc[11316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:47.685534 11561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f: Bootstrap starting.
I20260812 11:08:47.686394 11579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.674749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50068 (local address 127.18.174.253:38831)
0812 11:08:47.674863 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:47.674867 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:47.674924 (+ 57us) server_negotiation.cc:407] Connection header received
0812 11:08:47.675087 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:47.675090 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:47.675130 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:47.675190 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:47.675617 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.676295 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.677387 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.677614 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.677703 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.680439 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:47.680442 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:47.680445 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:47.680469 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:47.684350 (+ 3881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.684792 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.684796 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.684798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.684888 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.685439 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.685444 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.685445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.685710 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:47.685822 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:47.686118 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 11:08:47.686235 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:08:47.686427 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.674514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38831 (local address 127.0.0.1:50068)
0812 11:08:47.674861 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.674876 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:47.674982 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:47.675222 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:47.675225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:47.675406 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:47.675514 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.675520 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.676557 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.676560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.677278 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.677288 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.677718 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.677721 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.677825 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.678257 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:47.678272 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:47.680298 (+ 2026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:47.684441 (+ 4143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.684445 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.684447 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.684691 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.685035 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.685038 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.685040 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.685134 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.685828 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:47.685832 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:47.685943 (+ 111us) client_negotiation.cc:769] Sending connection context
0812 11:08:47.686048 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 11:08:47.686196 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282}
I20260812 11:08:47.687674 11442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.676463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46188 (local address 127.18.174.254:41331)
0812 11:08:47.676901 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:47.676906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:47.676921 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:08:47.676958 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:47.676962 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:47.677004 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:47.677076 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:47.677852 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.679292 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.680420 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.680730 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.680826 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.684424 (+ 3598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:47.684428 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:47.684431 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:47.684462 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:47.685963 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.686456 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.686460 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.686462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.686554 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.686857 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.686861 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.686863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.687048 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:47.687266 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:47.687411 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 11:08:47.687526 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:08:47.688935 11701 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:08:47.689567 11561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f: Neither blocks nor log segments found. Creating new log.
I20260812 11:08:47.690569 11561 log.cc:824] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:47.693187 11561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f: No bootstrap required, opened a new log
Aug 12 11:08:47 dist-test-slave-lgr5 krb5kdc[11316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532927, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.252@KRBTEST.COM for kudu/127.18.174.252@KRBTEST.COM
I20260812 11:08:47.695204 11435 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } attempt: 2
Aug 12 11:08:47 dist-test-slave-lgr5 krb5kdc[11316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.253@KRBTEST.COM
I20260812 11:08:47.697978 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.689466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56668 (local address 127.18.174.252:36963)
0812 11:08:47.689568 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:47.689572 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:47.689585 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:08:47.689658 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:47.689660 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:47.689701 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:47.689776 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:47.690095 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.690834 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.691830 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.692140 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.692246 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.694433 (+ 2187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:47.694437 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:47.694440 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:47.694465 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:47.696201 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.696667 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.696670 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.696672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.696755 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.697043 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.697046 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.697048 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.697276 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:47.697378 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:47.697658 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 11:08:47.697787 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":42}
I20260812 11:08:47.697793 11561 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } }
I20260812 11:08:47.698060 11561 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:08:47.698113 11561 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91ca01c12f0c457da3e49ae33883302f, State: Initialized, Role: FOLLOWER
I20260812 11:08:47.698711 11561 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } }
I20260812 11:08:47.699091 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.689401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:36963 (local address 127.0.0.1:56668)
0812 11:08:47.689514 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.689528 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:47.689594 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:47.689788 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:47.689790 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:47.689923 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:47.690002 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.690007 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.690947 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.690950 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.691685 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.691697 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.692242 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.692246 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.692353 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.692820 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:47.692838 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:47.694308 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:47.696328 (+ 2020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.696332 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.696334 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.696571 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.696850 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.696853 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.696855 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.696944 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.697370 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:47.697373 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:47.697474 (+ 101us) client_negotiation.cc:769] Sending connection context
0812 11:08:47.697585 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 11:08:47.698913 (+ 1328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":1131}
I20260812 11:08:47.700726 11579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.689185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50082 (local address 127.18.174.253:38831)
0812 11:08:47.689296 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:47.689300 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:47.689320 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:08:47.689354 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:47.689357 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:47.689400 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:47.689475 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:47.691623 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.692340 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.693392 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.693727 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.693863 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.696979 (+ 3116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:47.696983 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:47.697000 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:47.697029 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:47.698799 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.699370 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.699374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.699376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.699463 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.699773 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.699776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.699778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.699992 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:47.700212 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:47.700458 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 11:08:47.700585 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:08:47.702294 11720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } } }
I20260812 11:08:47.702492 11720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:08:47.702560 11701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c: Bootstrap starting.
Aug 12 11:08:47 dist-test-slave-lgr5 krb5kdc[11316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532927, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for kudu/127.18.174.252@KRBTEST.COM
I20260812 11:08:47.705013 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:08:47.705610 11701 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c: Neither blocks nor log segments found. Creating new log.
I20260812 11:08:47.706647 11701 log.cc:824] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:47.706923 11447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.695683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:36963 (local address 127.0.0.1:56670)
0812 11:08:47.695991 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:47.696007 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:47.696279 (+ 272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:47.696811 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:47.696815 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:47.697034 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:47.697183 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.697192 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.698797 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.698802 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.699609 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:47.699623 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.700967 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.700971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:47.701102 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.701625 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:47.701644 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:47.703194 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:47.705231 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.705236 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.705238 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.705468 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.705798 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:47.705803 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:47.705805 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:47.705898 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:47.706314 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:47.706318 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:47.706441 (+ 123us) client_negotiation.cc:769] Sending connection context
0812 11:08:47.706566 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 11:08:47.706734 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219}
I20260812 11:08:47.707504 11705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.696191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56670 (local address 127.18.174.252:36963)
0812 11:08:47.696441 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:47.696446 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:47.696459 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:08:47.696493 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:47.696496 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:47.696539 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:47.696615 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:47.697575 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.698658 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.700199 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.700555 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.700835 (+ 280us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.703372 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:47.703376 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:47.703379 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:47.703407 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:47.705112 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.705573 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.705577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.705579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.705672 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.705994 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.705998 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.706000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.706210 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:47.706309 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:47.707157 (+ 848us) server_negotiation.cc:299] Negotiation successful
0812 11:08:47.707313 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":173}
I20260812 11:08:47.707670 11561 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:08:47.711120 11435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874: Bootstrap starting.
I20260812 11:08:47.714609 11435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874: Neither blocks nor log segments found. Creating new log.
I20260812 11:08:47.711921 11446 master_runner.cc:186] Error getting master registration for 127.18.174.254:41331: OK, instance_id { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" instance_seqno: 1786532927157096 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:08:47.715981 11701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c: No bootstrap required, opened a new log
I20260812 11:08:47.716107 11446 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:08:47.716835 11435 log.cc:824] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:47.719018 11442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.708235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46192 (local address 127.18.174.254:41331)
0812 11:08:47.708364 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:47.708369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:47.708382 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:08:47.708583 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:47.708587 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:47.708640 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:47.708694 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:47.709714 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.710427 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.711670 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.711997 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.712116 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.714097 (+ 1981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:47.714102 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:47.714105 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:47.714133 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:47.716648 (+ 2515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.717385 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.717390 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.717392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.717498 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.717874 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.717878 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.717880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.718145 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:47.718252 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:47.718680 (+ 428us) server_negotiation.cc:299] Negotiation successful
0812 11:08:47.718834 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260812 11:08:47.719637 11763 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:08:47.719731 11763 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:08:47.720608 11701 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } }
I20260812 11:08:47.720906 11701 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:08:47.720976 11701 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2316f0d93847d19f4d9ddbef064a2c, State: Initialized, Role: FOLLOWER
I20260812 11:08:47.721494 11701 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } }
I20260812 11:08:47.722795 11435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874: No bootstrap required, opened a new log
I20260812 11:08:47.723047 11701 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:08:47.727375 11435 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } }
I20260812 11:08:47.727669 11435 raft_consensus.cc:374] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:08:47.727741 11435 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b4453d82bb4e5882b9d13f3aa29874, State: Initialized, Role: FOLLOWER
I20260812 11:08:47.728410 11435 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } }
I20260812 11:08:47.730043 11435 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:08:47.731570 11705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.708294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56678 (local address 127.18.174.252:36963)
0812 11:08:47.712280 (+ 3986us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:47.712284 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:47.717670 (+ 5386us) server_negotiation.cc:407] Connection header received
0812 11:08:47.717881 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:47.717885 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:47.717942 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:47.718003 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:47.718952 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.719690 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.721346 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.721676 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.721807 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.726655 (+ 4848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:47.726660 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:47.726663 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:47.726698 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:47.729050 (+ 2352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.729867 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.729872 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.729874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.729976 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.730398 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.730402 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.730404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.730654 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:47.730812 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:47.731239 (+ 427us) server_negotiation.cc:299] Negotiation successful
0812 11:08:47.731393 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3878}
I20260812 11:08:47.728904 11584 master_runner.cc:186] Error getting master registration for 127.18.174.254:41331: OK, instance_id { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" instance_seqno: 1786532927157096 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:08:47.732185 11584 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 11:08:47.733286 11779 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:08:47.733361 11779 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:08:47.732390 11766 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } } }
I20260812 11:08:47.733532 11766 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:08:47.735421 11579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:47.707493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50088 (local address 127.18.174.253:38831)
0812 11:08:47.707606 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:47.707611 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:47.710522 (+ 2911us) server_negotiation.cc:407] Connection header received
0812 11:08:47.710697 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:47.710700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:47.710748 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:47.710797 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:47.711906 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.712686 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.724019 (+ 11333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:47.724536 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:47.724652 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:47.728432 (+ 3780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:47.728436 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:47.728439 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:47.728470 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:47.730053 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.733851 (+ 3798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.733856 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.733857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.733977 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:47.734304 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:47.734308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:47.734310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:47.734547 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:47.734691 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:47.735120 (+ 429us) server_negotiation.cc:299] Negotiation successful
0812 11:08:47.735258 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260812 11:08:47.736258 11795 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:08:47.736351 11795 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:08:47.740368 11333 master_runner.cc:263] No leader master found from master a9b4453d82bb4e5882b9d13f3aa29874
I20260812 11:08:47.740445 11333 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:08:47.747850 11780 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } } }
I20260812 11:08:47.748039 11780 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:08:47.795876 11780 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:08:47.796134 11780 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } }
I20260812 11:08:47.797345 11780 leader_election.cc:288] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91ca01c12f0c457da3e49ae33883302f (127.18.174.253:38831), fe2316f0d93847d19f4d9ddbef064a2c (127.18.174.252:36963)
I20260812 11:08:47.798350 11650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" is_pre_election: true
I20260812 11:08:47.798745 11650 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b4453d82bb4e5882b9d13f3aa29874 in term 0.
I20260812 11:08:47.799471 11523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91ca01c12f0c457da3e49ae33883302f" is_pre_election: true
I20260812 11:08:47.799805 11523 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b4453d82bb4e5882b9d13f3aa29874 in term 0.
I20260812 11:08:47.800527 11359 leader_election.cc:302] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b4453d82bb4e5882b9d13f3aa29874, fe2316f0d93847d19f4d9ddbef064a2c; no voters:
I20260812 11:08:47.801388 11780 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:08:47.801494 11780 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:08:47.801544 11780 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:08:47.802950 11780 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } }
I20260812 11:08:47.803864 11523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91ca01c12f0c457da3e49ae33883302f"
I20260812 11:08:47.804049 11523 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:08:47.805552 11523 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b4453d82bb4e5882b9d13f3aa29874 in term 1.
I20260812 11:08:47.806020 11360 leader_election.cc:302] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91ca01c12f0c457da3e49ae33883302f, a9b4453d82bb4e5882b9d13f3aa29874; no voters:
I20260812 11:08:47.809655 11650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2316f0d93847d19f4d9ddbef064a2c"
I20260812 11:08:47.809818 11650 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:08:47.811221 11650 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b4453d82bb4e5882b9d13f3aa29874 in term 1.
I20260812 11:08:47.811622 11780 leader_election.cc:288] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [CANDIDATE]: Term 1 election: Requested vote from peers 91ca01c12f0c457da3e49ae33883302f (127.18.174.253:38831), fe2316f0d93847d19f4d9ddbef064a2c (127.18.174.252:36963)
I20260812 11:08:47.811803 11780 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:08:47.811918 11780 raft_consensus.cc:686] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [term 1 LEADER]: Becoming Leader. State: Replica: a9b4453d82bb4e5882b9d13f3aa29874, State: Running, Role: LEADER
I20260812 11:08:47.812326 11780 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } }
I20260812 11:08:47.814282 11780 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9b4453d82bb4e5882b9d13f3aa29874. Latest consensus state: current_term: 1 leader_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } } }
I20260812 11:08:47.814414 11780 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [sys.catalog]: This master's current role is: LEADER
I20260812 11:08:47.814884 11800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:08:47.815932 11800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:08:47.827587 11650 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c [term 1 FOLLOWER]: Refusing update from remote peer a9b4453d82bb4e5882b9d13f3aa29874: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:08:47.828428 11797 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:08:47.834165 11766 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9b4453d82bb4e5882b9d13f3aa29874. Latest consensus state: current_term: 1 leader_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } } }
I20260812 11:08:47.834326 11766 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:08:47.835639 11523 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f [term 1 FOLLOWER]: Refusing update from remote peer a9b4453d82bb4e5882b9d13f3aa29874: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:08:47.838490 11797 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:08:47.842773 11720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9b4453d82bb4e5882b9d13f3aa29874. Latest consensus state: current_term: 1 leader_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } } }
I20260812 11:08:47.842939 11720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:08:47.848126 11797 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } } }
I20260812 11:08:47.848282 11797 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [sys.catalog]: This master's current role is: LEADER
I20260812 11:08:47.849748 11720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } } }
I20260812 11:08:47.849885 11720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:08:47.850317 11801 mvcc.cc:205] Tried to move back new op lower bound from 7317638872357175296 to 7317638872322613248. Current Snapshot: MvccSnapshot[applied={T|T < 7317638872357175296}]
I20260812 11:08:47.850767 11804 mvcc.cc:205] Tried to move back new op lower bound from 7317638872357175296 to 7317638872322613248. Current Snapshot: MvccSnapshot[applied={T|T < 7317638872357175296}]
I20260812 11:08:47.855944 11780 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } } }
I20260812 11:08:47.856124 11780 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874 [sys.catalog]: This master's current role is: LEADER
I20260812 11:08:47.857406 11766 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9b4453d82bb4e5882b9d13f3aa29874" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 41331 } } peers { permanent_uuid: "91ca01c12f0c457da3e49ae33883302f" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38831 } } peers { permanent_uuid: "fe2316f0d93847d19f4d9ddbef064a2c" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 36963 } } }
I20260812 11:08:47.857554 11766 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:08:47.863610 11802 mvcc.cc:205] Tried to move back new op lower bound from 7317638872357175296 to 7317638872322613248. Current Snapshot: MvccSnapshot[applied={T|T < 7317638872357175296}]
I20260812 11:08:47.864863 11800 catalog_manager.cc:1347] Generated new cluster ID: 7dee677d7a494eaa9ab4f84981c8c5da
I20260812 11:08:47.864951 11800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:08:47.909438 11800 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:08:47.910791 11800 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:08:47.926455 11800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a9b4453d82bb4e5882b9d13f3aa29874: Generated new TSK 0
I20260812 11:08:47.927578 11800 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:08:48.721274 11763 catalog_manager.cc:1259] Loaded cluster ID: 7dee677d7a494eaa9ab4f84981c8c5da
I20260812 11:08:48.721393 11763 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f: loading cluster ID for follower catalog manager: success
I20260812 11:08:48.723330 11763 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f: acquiring CA information for follower catalog manager: success
I20260812 11:08:48.724776 11763 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 91ca01c12f0c457da3e49ae33883302f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:08:48.734794 11779 catalog_manager.cc:1259] Loaded cluster ID: 7dee677d7a494eaa9ab4f84981c8c5da
I20260812 11:08:48.734884 11779 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c: loading cluster ID for follower catalog manager: success
I20260812 11:08:48.736732 11779 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c: acquiring CA information for follower catalog manager: success
I20260812 11:08:48.737990 11779 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fe2316f0d93847d19f4d9ddbef064a2c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:08:48.994954 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 11333
I20260812 11:08:49.013067 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 11446
I20260812 11:08:49.026048 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 11584
2026-08-12T11:08:49Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3408 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:08:49 dist-test-slave-lgr5 krb5kdc[11817](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:08:49 dist-test-slave-lgr5 krb5kdc[11817](info): set up 2 sockets
Aug 12 11:08:49 dist-test-slave-lgr5 krb5kdc[11817](info): commencing operation
krb5kdc: starting...
W20260812 11:08:50.253998 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:08:50 dist-test-slave-lgr5 krb5kdc[11817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:08:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:08:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:08:50.387609 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:37849
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:46033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:37849
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:08:50.505505 11838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:50.505793 11838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:50.505849 11838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:50.509927 11838 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:08:50.509992 11838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:50.510020 11838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:50.510042 11838 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:08:50.510068 11838 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:08:50.515571 11838 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:37849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:37849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:50.516809 11838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:50.517907 11838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:50.527103 11847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:50.527105 11849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:50.527252 11838 server_base.cc:1034] running on GCE node
W20260812 11:08:50.527103 11851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:50.528040 11838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:50.529258 11838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:50.530433 11838 hybrid_clock.cc:648] HybridClock initialized: now 1786532930530413 us; error 32 us; skew 500 ppm
Aug 12 11:08:50 dist-test-slave-lgr5 krb5kdc[11817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532930, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:50.533357 11838 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:08:50.534310 11838 webserver.cc:460] Webserver started at http://127.18.174.254:33233/ using document root <none> and password file <none>
I20260812 11:08:50.534893 11838 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:50.534951 11838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:50.535140 11838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:08:50.537309 11838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "85e68afd2f0d46c39e0c189c4bc8d134"
format_stamp: "Formatted at 2026-08-12 11:08:50 on dist-test-slave-lgr5"
server_key: "211e23c7b14265ab99e7b36f05d9bf00"
server_key_iv: "1b5936e74bc13b71c4fdffe110f2cd04"
server_key_version: "encryptionkey@0"
I20260812 11:08:50.537871 11838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "85e68afd2f0d46c39e0c189c4bc8d134"
format_stamp: "Formatted at 2026-08-12 11:08:50 on dist-test-slave-lgr5"
server_key: "211e23c7b14265ab99e7b36f05d9bf00"
server_key_iv: "1b5936e74bc13b71c4fdffe110f2cd04"
server_key_version: "encryptionkey@0"
I20260812 11:08:50.541956 11838 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:08:50.544540 11869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:50.545827 11838 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:08:50.545948 11838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "85e68afd2f0d46c39e0c189c4bc8d134"
format_stamp: "Formatted at 2026-08-12 11:08:50 on dist-test-slave-lgr5"
server_key: "211e23c7b14265ab99e7b36f05d9bf00"
server_key_iv: "1b5936e74bc13b71c4fdffe110f2cd04"
server_key_version: "encryptionkey@0"
I20260812 11:08:50.546080 11838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:50.577634 11838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:50.580749 11838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:50.580935 11838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:50.588399 11838 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:37849
I20260812 11:08:50.588443 11956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:37849 every 8 connection(s)
I20260812 11:08:50.589447 11838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:08:50.592746 11958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:08:50.595697 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 11838
I20260812 11:08:50.595835 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:08:50.596210 19131 external_mini_cluster.cc:1428] Setting key 0b3409ed9b684f81b3cd99452ff3952a
I20260812 11:08:50.599280 11958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134: Bootstrap starting.
I20260812 11:08:50.601675 11958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134: Neither blocks nor log segments found. Creating new log.
I20260812 11:08:50.602473 11958 log.cc:824] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:50.604676 11958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134: No bootstrap required, opened a new log
Aug 12 11:08:50 dist-test-slave-lgr5 krb5kdc[11817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:50.608337 11958 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e68afd2f0d46c39e0c189c4bc8d134" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37849 } }
I20260812 11:08:50.608594 11958 raft_consensus.cc:374] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:08:50.608634 11958 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e68afd2f0d46c39e0c189c4bc8d134, State: Initialized, Role: FOLLOWER
I20260812 11:08:50.609179 11958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e68afd2f0d46c39e0c189c4bc8d134" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37849 } }
I20260812 11:08:50.609344 11958 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:08:50.609412 11958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:08:50.609517 11958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:08:50.610553 11958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e68afd2f0d46c39e0c189c4bc8d134" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37849 } }
I20260812 11:08:50.610920 11958 leader_election.cc:302] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85e68afd2f0d46c39e0c189c4bc8d134; no voters:
I20260812 11:08:50.611238 11958 leader_election.cc:288] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:08:50.611361 11966 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:08:50.611552 11966 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [term 1 LEADER]: Becoming Leader. State: Replica: 85e68afd2f0d46c39e0c189c4bc8d134, State: Running, Role: LEADER
I20260812 11:08:50.611915 11963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:50.597661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41960 (local address 127.18.174.254:37849)
0812 11:08:50.598148 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:50.598168 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:50.598352 (+ 184us) server_negotiation.cc:407] Connection header received
0812 11:08:50.599122 (+ 770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:50.599143 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:50.599538 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:50.599873 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:50.600720 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:50.601775 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:50.602692 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:50.603365 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:50.603525 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:50.606387 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:50.606393 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:50.606408 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:50.606440 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:50.608749 (+ 2309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:50.609240 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:50.609245 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:50.609249 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:50.609391 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:50.609689 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:50.609691 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:50.609692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:50.610124 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:50.610284 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:50.610593 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 11:08:50.610938 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":131,"threads_started":1}
I20260812 11:08:50.611931 11966 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e68afd2f0d46c39e0c189c4bc8d134" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37849 } }
I20260812 11:08:50.612641 11958 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:08:50.613850 11968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "85e68afd2f0d46c39e0c189c4bc8d134" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e68afd2f0d46c39e0c189c4bc8d134" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37849 } } }
I20260812 11:08:50.613860 11971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85e68afd2f0d46c39e0c189c4bc8d134. Latest consensus state: current_term: 1 leader_uuid: "85e68afd2f0d46c39e0c189c4bc8d134" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85e68afd2f0d46c39e0c189c4bc8d134" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37849 } } }
I20260812 11:08:50.613997 11971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [sys.catalog]: This master's current role is: LEADER
I20260812 11:08:50.613996 11968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134 [sys.catalog]: This master's current role is: LEADER
I20260812 11:08:50.614650 11980 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:08:50.615520 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:08:50.618371 11980 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:08:50.623869 11980 catalog_manager.cc:1347] Generated new cluster ID: 93d936133c344ebb87480443ac54761a
I20260812 11:08:50.623955 11980 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:08:50.634235 11980 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:08:50.635663 11980 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:08:50.645670 11980 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 85e68afd2f0d46c39e0c189c4bc8d134: Generated new TSK 0
I20260812 11:08:50.646651 11980 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:08:50.672752 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 11838
2026-08-12T11:08:50Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1643 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:08:50 dist-test-slave-lgr5 krb5kdc[11999](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:08:50 dist-test-slave-lgr5 krb5kdc[11999](info): set up 2 sockets
Aug 12 11:08:50 dist-test-slave-lgr5 krb5kdc[11999](info): commencing operation
krb5kdc: starting...
W20260812 11:08:51.871904 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:08:51 dist-test-slave-lgr5 krb5kdc[11999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:08:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:08:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:08:52.008219 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45957
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:41839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:45957
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:08:52.126695 12019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:52.127044 12019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:52.127172 12019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:52.131302 12019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:08:52.131369 12019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:52.131388 12019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:52.131403 12019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:08:52.131417 12019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:08:52.136963 12019 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:41839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:45957
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:52.138067 12019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:52.139308 12019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:52.148378 12026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:52.148469 12028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:52.148415 12025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:52.148806 12019 server_base.cc:1034] running on GCE node
I20260812 11:08:52.149520 12019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:52.150755 12019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:52.151947 12019 hybrid_clock.cc:648] HybridClock initialized: now 1786532932151929 us; error 37 us; skew 500 ppm
Aug 12 11:08:52 dist-test-slave-lgr5 krb5kdc[11999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532932, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:52.154934 12019 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:08:52.155993 12019 webserver.cc:460] Webserver started at http://127.18.174.254:43051/ using document root <none> and password file <none>
I20260812 11:08:52.156639 12019 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:52.156709 12019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:52.156895 12019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:08:52.159088 12019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "9fe816679c8442bb913a396c46ad863f"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "863ead4723a76190c743ceb1f2b1fab1"
server_key_iv: "5a58c524d066ef26a0fc9b4bc9a27e82"
server_key_version: "encryptionkey@0"
I20260812 11:08:52.159662 12019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "9fe816679c8442bb913a396c46ad863f"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "863ead4723a76190c743ceb1f2b1fab1"
server_key_iv: "5a58c524d066ef26a0fc9b4bc9a27e82"
server_key_version: "encryptionkey@0"
I20260812 11:08:52.163801 12019 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260812 11:08:52.166672 12039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:52.168035 12019 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 11:08:52.168219 12019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "9fe816679c8442bb913a396c46ad863f"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "863ead4723a76190c743ceb1f2b1fab1"
server_key_iv: "5a58c524d066ef26a0fc9b4bc9a27e82"
server_key_version: "encryptionkey@0"
I20260812 11:08:52.168339 12019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:52.197877 12019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:52.201356 12019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:52.201572 12019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:52.209074 12019 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:45957
I20260812 11:08:52.209349 12125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:45957 every 8 connection(s)
I20260812 11:08:52.210192 12019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:08:52.213253 12126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:08:52.216254 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 12019
I20260812 11:08:52.216368 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:08:52.216645 19131 external_mini_cluster.cc:1428] Setting key ac14876d098d4bbaed69e49bd89bd09b
I20260812 11:08:52.219544 12126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: Bootstrap starting.
I20260812 11:08:52.222246 12126 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: Neither blocks nor log segments found. Creating new log.
I20260812 11:08:52.223188 12126 log.cc:824] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:52.225329 12126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: No bootstrap required, opened a new log
Aug 12 11:08:52 dist-test-slave-lgr5 krb5kdc[11999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532931, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:52.229966 12126 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } }
I20260812 11:08:52.230284 12126 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:08:52.230353 12126 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe816679c8442bb913a396c46ad863f, State: Initialized, Role: FOLLOWER
I20260812 11:08:52.230880 12126 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } }
I20260812 11:08:52.231055 12126 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:08:52.231118 12126 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:08:52.231213 12126 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:08:52.231644 12129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:52.218085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47942 (local address 127.18.174.254:45957)
0812 11:08:52.218508 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:52.218525 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:52.218563 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:08:52.219194 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:52.219212 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:52.219582 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:52.219901 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:52.220847 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:52.221893 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:52.223069 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:52.223615 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:52.223741 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:52.226249 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:52.226256 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:52.226275 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:52.226308 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:52.228305 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:52.228767 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:52.228773 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:52.228781 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:52.228940 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:52.229167 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:52.229171 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:52.229172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:52.229755 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:52.229976 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:52.230166 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 11:08:52.230597 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":110,"threads_started":1}
I20260812 11:08:52.232406 12126 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } }
I20260812 11:08:52.232782 12126 leader_election.cc:302] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fe816679c8442bb913a396c46ad863f; no voters:
I20260812 11:08:52.233165 12126 leader_election.cc:288] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:08:52.233310 12132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:08:52.233532 12132 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 1 LEADER]: Becoming Leader. State: Replica: 9fe816679c8442bb913a396c46ad863f, State: Running, Role: LEADER
I20260812 11:08:52.233872 12132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } }
I20260812 11:08:52.234488 12126 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:08:52.235638 12134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fe816679c8442bb913a396c46ad863f. Latest consensus state: current_term: 1 leader_uuid: "9fe816679c8442bb913a396c46ad863f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } } }
I20260812 11:08:52.235776 12134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [sys.catalog]: This master's current role is: LEADER
I20260812 11:08:52.236063 12133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9fe816679c8442bb913a396c46ad863f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } } }
I20260812 11:08:52.236227 12133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [sys.catalog]: This master's current role is: LEADER
I20260812 11:08:52.236186 12150 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:08:52.239153 12150 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:08:52.245777 12150 catalog_manager.cc:1347] Generated new cluster ID: 79d119f157df47f488e38806e530a260
I20260812 11:08:52.245877 12150 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:08:52.272753 12150 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:08:52.273866 12150 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:08:52.286198 12150 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: Generated new TSK 0
I20260812 11:08:52.287199 12150 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:08:52.327709 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45957
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:41839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:08:52.445662 12180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:52.445940 12180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:52.445992 12180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:52.450089 12180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:52.450162 12180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:52.450224 12180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:08:52.455760 12180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:41839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:52.456905 12180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:52.457989 12180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:52.467808 12190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:52.467851 12187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:52.467851 12185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:52.468096 12180 server_base.cc:1034] running on GCE node
I20260812 11:08:52.468536 12180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:52.469178 12180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:52.470325 12180 hybrid_clock.cc:648] HybridClock initialized: now 1786532932470303 us; error 48 us; skew 500 ppm
Aug 12 11:08:52 dist-test-slave-lgr5 krb5kdc[11999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532932, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:52.476842 12180 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:08:52.477876 12180 webserver.cc:460] Webserver started at http://127.18.174.193:37733/ using document root <none> and password file <none>
I20260812 11:08:52.478492 12180 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:52.478569 12180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:52.478796 12180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:08:52.481093 12180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "84eba57166ea4175adf9ae193e3bb951"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "27351dd656b987364197be08ea1245b8"
server_key_iv: "998659f6eaec86237535626ad7095c70"
server_key_version: "encryptionkey@0"
I20260812 11:08:52.481673 12180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "84eba57166ea4175adf9ae193e3bb951"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "27351dd656b987364197be08ea1245b8"
server_key_iv: "998659f6eaec86237535626ad7095c70"
server_key_version: "encryptionkey@0"
I20260812 11:08:52.485728 12180 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:08:52.488394 12203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:52.489845 12180 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:08:52.489974 12180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "84eba57166ea4175adf9ae193e3bb951"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "27351dd656b987364197be08ea1245b8"
server_key_iv: "998659f6eaec86237535626ad7095c70"
server_key_version: "encryptionkey@0"
I20260812 11:08:52.490087 12180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:52.516158 12180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:52.519657 12180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:52.519868 12180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:52.520689 12180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:08:52.521672 12180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:08:52.521728 12180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:52.521790 12180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:08:52.521821 12180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:52.530989 12180 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:33237
I20260812 11:08:52.531018 12384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:33237 every 8 connection(s)
I20260812 11:08:52.531930 12180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:08:52.535812 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 12180
I20260812 11:08:52.535961 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:08:52.536355 19131 external_mini_cluster.cc:1428] Setting key 0d1f37fc7c93ad1c6bbd9422c0386f92
Aug 12 11:08:52 dist-test-slave-lgr5 krb5kdc[11999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532932, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
I20260812 11:08:52.548207 12129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:52.533919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:33845 (local address 127.18.174.254:45957)
0812 11:08:52.534095 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:52.534100 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:52.534962 (+ 862us) server_negotiation.cc:407] Connection header received
0812 11:08:52.536795 (+ 1833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:52.536800 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:52.536866 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:52.536953 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:52.538838 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:52.539412 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:52.540837 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:52.541079 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:52.541176 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:52.544281 (+ 3105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:52.544286 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:52.544289 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:52.544320 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:52.545825 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:52.546426 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:52.546429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:52.546430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:52.546517 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:52.546906 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:52.546909 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:52.546910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:52.547116 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:52.547205 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:52.547846 (+ 641us) server_negotiation.cc:299] Negotiation successful
0812 11:08:52.547993 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
I20260812 11:08:52.549295 12390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:52.534282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:33845)
0812 11:08:52.534774 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:52.534839 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:52.536539 (+ 1700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:52.537356 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:52.537364 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:52.537845 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:52.538628 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:52.538653 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:52.539558 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:52.539561 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:52.540700 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:52.540712 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:52.541244 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:52.541248 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:52.541439 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:52.542116 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:52.542134 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:52.544021 (+ 1887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:52.545979 (+ 1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:52.545987 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:52.546008 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:52.546309 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:52.546604 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:52.546607 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:52.546609 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:52.546802 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:52.547222 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:52.547231 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:52.547572 (+ 341us) client_negotiation.cc:769] Sending connection context
0812 11:08:52.547755 (+ 183us) client_negotiation.cc:240] Negotiation successful
0812 11:08:52.548167 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":129,"threads_started":1}
I20260812 11:08:52.550814 12387 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45957
I20260812 11:08:52.551116 12387 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:52.551770 12387 heartbeater.cc:511] Master 127.18.174.254:45957 requested a full tablet report, sending...
I20260812 11:08:52.553419 12071 ts_manager.cc:194] Registered new tserver with Master: 84eba57166ea4175adf9ae193e3bb951 (127.18.174.193:33237)
I20260812 11:08:52.554666 12071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:33845
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:08:52.566612 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45957
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:41839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:08:52.685345 12395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:52.685638 12395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:52.685688 12395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:52.689744 12395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:52.689815 12395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:52.689874 12395 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:08:52.695488 12395 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:41839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:52.696709 12395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:52.697800 12395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:52.708726 12409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:52.708719 12411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:52.708719 12407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:52.708906 12395 server_base.cc:1034] running on GCE node
I20260812 11:08:52.709434 12395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:52.710139 12395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:52.711305 12395 hybrid_clock.cc:648] HybridClock initialized: now 1786532932711269 us; error 47 us; skew 500 ppm
Aug 12 11:08:52 dist-test-slave-lgr5 krb5kdc[11999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532932, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:52.714028 12395 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:08:52.714943 12395 webserver.cc:460] Webserver started at http://127.18.174.194:37801/ using document root <none> and password file <none>
I20260812 11:08:52.715517 12395 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:52.715587 12395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:52.715802 12395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:08:52.717957 12395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "3f24c8d8577f4706b0300e27a437126d"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "1893657d4c92aa8bde58420e56daf29c"
server_key_iv: "75cbac8bc273deef40929be058b87fa4"
server_key_version: "encryptionkey@0"
I20260812 11:08:52.718513 12395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "3f24c8d8577f4706b0300e27a437126d"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "1893657d4c92aa8bde58420e56daf29c"
server_key_iv: "75cbac8bc273deef40929be058b87fa4"
server_key_version: "encryptionkey@0"
I20260812 11:08:52.722359 12395 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:08:52.725011 12421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:52.726293 12395 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:08:52.726418 12395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "3f24c8d8577f4706b0300e27a437126d"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "1893657d4c92aa8bde58420e56daf29c"
server_key_iv: "75cbac8bc273deef40929be058b87fa4"
server_key_version: "encryptionkey@0"
I20260812 11:08:52.726526 12395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:52.741019 12395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:52.744396 12395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:52.744591 12395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:52.745232 12395 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:08:52.746163 12395 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:08:52.746227 12395 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:52.746294 12395 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:08:52.746318 12395 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:52.755412 12395 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:33433
I20260812 11:08:52.755451 12611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:33433 every 8 connection(s)
I20260812 11:08:52.756492 12395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:08:52.764400 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 12395
I20260812 11:08:52.764528 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:08:52.764787 19131 external_mini_cluster.cc:1428] Setting key 32b94f5766b880a1f47268247cf0d8b6
Aug 12 11:08:52 dist-test-slave-lgr5 krb5kdc[11999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532932, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:52.771428 12129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:52.758525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:45559 (local address 127.18.174.254:45957)
0812 11:08:52.758684 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:52.758688 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:52.759565 (+ 877us) server_negotiation.cc:407] Connection header received
0812 11:08:52.761025 (+ 1460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:52.761028 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:52.761079 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:52.761145 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:52.762451 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:52.762984 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:52.764220 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:52.764464 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:52.764569 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:52.767287 (+ 2718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:52.767290 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:52.767292 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:52.767326 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:52.768808 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:52.769507 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:52.769510 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:52.769511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:52.769589 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:52.769982 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:52.769985 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:52.769991 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:52.770185 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:52.770257 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:52.771043 (+ 786us) server_negotiation.cc:299] Negotiation successful
0812 11:08:52.771205 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:08:52.772771 12615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:52.758897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:45559)
0812 11:08:52.759378 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:52.759426 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:52.760787 (+ 1361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:52.761311 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:52.761318 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:52.761762 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:52.762288 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:52.762303 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:52.763103 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:52.763106 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:52.764051 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:52.764062 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:52.764647 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:52.764653 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:52.764833 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:52.765446 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:52.765463 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:52.767100 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:52.768947 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:52.768954 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:52.768976 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:52.769395 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:52.769676 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:52.769680 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:52.769681 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:52.769892 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:52.770283 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:52.770290 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:52.770684 (+ 394us) client_negotiation.cc:769] Sending connection context
0812 11:08:52.770917 (+ 233us) client_negotiation.cc:240] Negotiation successful
0812 11:08:52.771417 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":114,"threads_started":1}
I20260812 11:08:52.774390 12612 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45957
I20260812 11:08:52.774719 12612 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:52.775477 12612 heartbeater.cc:511] Master 127.18.174.254:45957 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
I20260812 11:08:52.777347 12071 ts_manager.cc:194] Registered new tserver with Master: 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433)
I20260812 11:08:52.778087 12071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:45559
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:08:52.799854 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45957
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:41839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:08:52.915777 12622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:52.916100 12622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:52.916148 12622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:52.920305 12622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:52.920380 12622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:52.920450 12622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:08:52.926091 12622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:41839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:45957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:52.927318 12622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:52.928496 12622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:52.939141 12637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:52.939167 12638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:52.939196 12622 server_base.cc:1034] running on GCE node
W20260812 11:08:52.939144 12642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:52.939905 12622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:52.940671 12622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:52.941856 12622 hybrid_clock.cc:648] HybridClock initialized: now 1786532932941837 us; error 31 us; skew 500 ppm
Aug 12 11:08:52 dist-test-slave-lgr5 krb5kdc[11999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532932, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:52.944986 12622 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:08:52.946036 12622 webserver.cc:460] Webserver started at http://127.18.174.195:33443/ using document root <none> and password file <none>
I20260812 11:08:52.946659 12622 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:52.946736 12622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:52.946949 12622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:08:52.949175 12622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "17a92247488e4614842d1be3090e17d2"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "1f0e44ad1fcc98b4218967979170f805"
server_key_iv: "76d200269e3e3b04a1a1d98cfbacb5d8"
server_key_version: "encryptionkey@0"
I20260812 11:08:52.949772 12622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "17a92247488e4614842d1be3090e17d2"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "1f0e44ad1fcc98b4218967979170f805"
server_key_iv: "76d200269e3e3b04a1a1d98cfbacb5d8"
server_key_version: "encryptionkey@0"
I20260812 11:08:52.953752 12622 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:08:52.956744 12654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:52.958102 12622 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:08:52.958235 12622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "17a92247488e4614842d1be3090e17d2"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "1f0e44ad1fcc98b4218967979170f805"
server_key_iv: "76d200269e3e3b04a1a1d98cfbacb5d8"
server_key_version: "encryptionkey@0"
I20260812 11:08:52.958390 12622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:52.973660 12622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:52.977088 12622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:52.977294 12622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:52.977960 12622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:08:52.978935 12622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:08:52.978986 12622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:52.979043 12622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:08:52.979074 12622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:52.988059 12622 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:32889
I20260812 11:08:52.988147 12842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:32889 every 8 connection(s)
I20260812 11:08:52.989107 12622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:08:52.997447 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 12622
I20260812 11:08:52.997591 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:08:52.997960 19131 external_mini_cluster.cc:1428] Setting key 35246e8735e6b29e0ba34dbdbb5ad22f
Aug 12 11:08:52 dist-test-slave-lgr5 krb5kdc[11999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532932, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:53.003372 12129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:52.990971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:54339 (local address 127.18.174.254:45957)
0812 11:08:52.991109 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:52.991112 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:52.992000 (+ 888us) server_negotiation.cc:407] Connection header received
0812 11:08:52.993464 (+ 1464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:52.993468 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:52.993540 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:52.993614 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:52.994909 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:52.995456 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:52.996692 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:52.996910 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:52.997004 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:52.999928 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:52.999931 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:52.999934 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:52.999964 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:53.001391 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:53.001928 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:53.001931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:53.001932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:53.002027 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:53.002334 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:53.002337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:53.002338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:53.002525 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:53.002601 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:53.003139 (+ 538us) server_negotiation.cc:299] Negotiation successful
0812 11:08:53.003249 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:08:53.004388 12846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:52.991353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:54339)
0812 11:08:52.991834 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:52.991881 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:52.993236 (+ 1355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:52.993854 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:52.993862 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:52.994246 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:52.994749 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:52.994764 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:52.995591 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:52.995595 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:52.996566 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:52.996577 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:52.997068 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:52.997073 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:52.997244 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:52.997896 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:52.997915 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:52.999754 (+ 1839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:53.001508 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:53.001514 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:53.001529 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:53.001827 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:53.002106 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:53.002108 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:53.002109 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:53.002266 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:53.002649 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:53.002655 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:53.002926 (+ 271us) client_negotiation.cc:769] Sending connection context
0812 11:08:53.003107 (+ 181us) client_negotiation.cc:240] Negotiation successful
0812 11:08:53.003444 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":118,"threads_started":1}
I20260812 11:08:53.005591 12844 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45957
I20260812 11:08:53.005851 12844 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:53.006395 12844 heartbeater.cc:511] Master 127.18.174.254:45957 requested a full tablet report, sending...
I20260812 11:08:53.007553 12071 ts_manager.cc:194] Registered new tserver with Master: 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889)
I20260812 11:08:53.008173 12071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:54339
I20260812 11:08:53.012406 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:08:53.021092 12129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.014389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47948 (local address 127.18.174.254:45957)
0812 11:08:53.014523 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:53.014528 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:53.014711 (+ 183us) server_negotiation.cc:407] Connection header received
0812 11:08:53.014816 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:53.014818 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:53.014859 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:53.014921 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:53.015584 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.016136 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.016899 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.017114 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.017182 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.018420 (+ 1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:53.018423 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:53.018425 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:53.018441 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:53.019631 (+ 1190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:53.020007 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:53.020010 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:53.020011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:53.020132 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:53.020338 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:53.020340 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:53.020341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:53.020563 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:53.020666 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:53.020827 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 11:08:53.020921 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:08:53.023967 12071 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47948:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:08:53.027078 12071 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:08:53.042227 12860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.036591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:33237 (local address 127.0.0.1:55200)
0812 11:08:53.036968 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:53.037029 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:53.037173 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:53.038000 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:53.038007 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:53.038033 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:08:53.038172 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.038180 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.039529 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.039532 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.040688 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.040698 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.041553 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.041557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.041745 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.041793 (+ 48us) client_negotiation.cc:769] Sending connection context
0812 11:08:53.041914 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 11:08:53.042055 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":25,"thread_start_us":107,"threads_started":1}
I20260812 11:08:53.042246 12861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.036776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55200 (local address 127.18.174.193:33237)
0812 11:08:53.037132 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:53.037153 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:53.037179 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:08:53.037357 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:53.037364 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:53.037603 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:53.037760 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:08:53.038290 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.039396 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.040826 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.041406 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.041562 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.041778 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:53.041978 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 11:08:53.042091 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":121,"threads_started":1}
I20260812 11:08:53.043087 12863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.037522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:32889 (local address 127.0.0.1:56352)
0812 11:08:53.038178 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:53.038192 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:53.038268 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:53.038802 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:53.038805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:53.038822 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:08:53.038912 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.038919 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.040246 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.040250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.041550 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.041576 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.042681 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.042685 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.042781 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.042808 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 11:08:53.042875 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:08:53.042948 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"mutex_wait_us":26,"thread_start_us":94,"threads_started":1}
I20260812 11:08:53.043152 12867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.037937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56352 (local address 127.18.174.195:32889)
0812 11:08:53.038436 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:53.038445 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:53.038462 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:08:53.038523 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:53.038526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:53.038670 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:53.038800 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:08:53.039009 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.040072 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.041731 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.042556 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.042676 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.042798 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:53.042907 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 11:08:53.043015 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":153,"threads_started":1}
I20260812 11:08:53.043668 12865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.037328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:33433 (local address 127.0.0.1:52062)
0812 11:08:53.038038 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:53.038052 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:53.038142 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:53.039047 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:53.039050 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:53.039067 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:08:53.039148 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.039153 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.040490 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.040494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.041730 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.041739 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.043069 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.043072 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.043393 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.043419 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:08:53.043480 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 11:08:53.043552 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"mutex_wait_us":72,"thread_start_us":103,"threads_started":1}
I20260812 11:08:53.044098 12866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.037790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52062 (local address 127.18.174.194:33433)
0812 11:08:53.038427 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:53.038438 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:53.038461 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:08:53.038537 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:53.038542 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:53.038734 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:53.038873 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:08:53.039279 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.040345 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.041862 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.042743 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.042862 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.043004 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:53.043826 (+ 822us) server_negotiation.cc:299] Negotiation successful
0812 11:08:53.043927 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":118,"threads_started":1}
I20260812 11:08:53.046001 12736 tablet_service.cc:1467] Processing CreateTablet for tablet 0935daa7d8954ac1ba6514c0e19e821e (DEFAULT_TABLE table=test-table [id=c273214d99f845c8865695c01b448e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:08:53.045997 12289 tablet_service.cc:1467] Processing CreateTablet for tablet 0935daa7d8954ac1ba6514c0e19e821e (DEFAULT_TABLE table=test-table [id=c273214d99f845c8865695c01b448e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:08:53.046490 12500 tablet_service.cc:1467] Processing CreateTablet for tablet 0935daa7d8954ac1ba6514c0e19e821e (DEFAULT_TABLE table=test-table [id=c273214d99f845c8865695c01b448e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:08:53.047199 12289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0935daa7d8954ac1ba6514c0e19e821e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:08:53.047202 12736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0935daa7d8954ac1ba6514c0e19e821e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:08:53.047477 12500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0935daa7d8954ac1ba6514c0e19e821e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:08:53.053901 12868 tablet_bootstrap.cc:492] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d: Bootstrap starting.
I20260812 11:08:53.055266 12870 tablet_bootstrap.cc:492] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: Bootstrap starting.
I20260812 11:08:53.055414 12871 tablet_bootstrap.cc:492] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2: Bootstrap starting.
I20260812 11:08:53.056627 12868 tablet_bootstrap.cc:654] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d: Neither blocks nor log segments found. Creating new log.
I20260812 11:08:53.057361 12868 log.cc:824] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:53.057556 12870 tablet_bootstrap.cc:654] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: Neither blocks nor log segments found. Creating new log.
I20260812 11:08:53.057991 12871 tablet_bootstrap.cc:654] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2: Neither blocks nor log segments found. Creating new log.
I20260812 11:08:53.058418 12870 log.cc:824] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:53.058773 12871 log.cc:824] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:53.059479 12868 tablet_bootstrap.cc:492] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d: No bootstrap required, opened a new log
I20260812 11:08:53.059685 12868 ts_tablet_manager.cc:1397] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:08:53.060349 12870 tablet_bootstrap.cc:492] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: No bootstrap required, opened a new log
I20260812 11:08:53.060566 12870 ts_tablet_manager.cc:1397] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260812 11:08:53.060806 12871 tablet_bootstrap.cc:492] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2: No bootstrap required, opened a new log
I20260812 11:08:53.061000 12871 ts_tablet_manager.cc:1397] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260812 11:08:53.062999 12868 raft_consensus.cc:348] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } } peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } }
I20260812 11:08:53.063275 12868 raft_consensus.cc:374] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:08:53.063329 12868 raft_consensus.cc:729] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f24c8d8577f4706b0300e27a437126d, State: Initialized, Role: FOLLOWER
I20260812 11:08:53.063752 12868 consensus_queue.cc:260] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } } peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } }
I20260812 11:08:53.064486 12612 heartbeater.cc:503] Master 127.18.174.254:45957 was elected leader, sending a full tablet report...
I20260812 11:08:53.064750 12868 ts_tablet_manager.cc:1428] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 11:08:53.064795 12871 raft_consensus.cc:348] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } } peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } }
I20260812 11:08:53.065052 12871 raft_consensus.cc:374] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:08:53.065112 12871 raft_consensus.cc:729] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a92247488e4614842d1be3090e17d2, State: Initialized, Role: FOLLOWER
I20260812 11:08:53.065295 12870 raft_consensus.cc:348] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } } peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } }
I20260812 11:08:53.065534 12870 raft_consensus.cc:374] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:08:53.065582 12870 raft_consensus.cc:729] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84eba57166ea4175adf9ae193e3bb951, State: Initialized, Role: FOLLOWER
I20260812 11:08:53.065577 12871 consensus_queue.cc:260] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } } peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } }
I20260812 11:08:53.065985 12870 consensus_queue.cc:260] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } } peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } }
I20260812 11:08:53.066550 12871 ts_tablet_manager.cc:1428] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 11:08:53.066751 12870 ts_tablet_manager.cc:1428] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:08:53.066906 12844 heartbeater.cc:503] Master 127.18.174.254:45957 was elected leader, sending a full tablet report...
I20260812 11:08:53.067178 12387 heartbeater.cc:503] Master 127.18.174.254:45957 was elected leader, sending a full tablet report...
I20260812 11:08:53.229179 12877 raft_consensus.cc:482] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:08:53.229417 12877 raft_consensus.cc:504] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } } peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } }
I20260812 11:08:53.230734 12877 leader_election.cc:288] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84eba57166ea4175adf9ae193e3bb951 (127.18.174.193:33237), 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433)
I20260812 11:08:53.235235 12861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.231208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:52579 (local address 127.18.174.193:33237)
0812 11:08:53.231364 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:53.231368 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:53.231391 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:08:53.231520 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:53.231524 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:53.231587 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:53.231700 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:08:53.232117 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.232860 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.234059 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.234620 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.234763 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.234823 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:53.235030 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 11:08:53.235106 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 11:08:53.235235 12846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.231092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:33237 (local address 127.18.174.195:52579)
0812 11:08:53.231238 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:53.231254 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:53.231392 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:53.231832 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:53.231834 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:53.231853 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:08:53.231957 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.231968 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.232987 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.232990 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.233909 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.233921 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.234784 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.234788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.234897 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.234917 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:08:53.234997 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 11:08:53.235091 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 11:08:53.235599 12866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.231606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:41981 (local address 127.18.174.194:33433)
0812 11:08:53.231768 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:53.231773 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:53.232133 (+ 360us) server_negotiation.cc:407] Connection header received
0812 11:08:53.232274 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:53.232277 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:53.232323 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:53.232390 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:08:53.232667 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.233242 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.234454 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.234913 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.235037 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.235077 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:53.235358 (+ 281us) server_negotiation.cc:299] Negotiation successful
0812 11:08:53.235474 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 11:08:53.235652 12880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.231456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:33433 (local address 127.18.174.195:41981)
0812 11:08:53.232000 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:53.232016 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:53.232177 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:53.232418 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:53.232421 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:53.232441 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:08:53.232569 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.232575 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.233414 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.233417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.234306 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.234317 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.235152 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.235155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.235234 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.235252 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 11:08:53.235315 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 11:08:53.235531 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":160,"threads_started":1}
I20260812 11:08:53.236178 12318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0935daa7d8954ac1ba6514c0e19e821e" candidate_uuid: "17a92247488e4614842d1be3090e17d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84eba57166ea4175adf9ae193e3bb951" is_pre_election: true
I20260812 11:08:53.236254 12537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0935daa7d8954ac1ba6514c0e19e821e" candidate_uuid: "17a92247488e4614842d1be3090e17d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f24c8d8577f4706b0300e27a437126d" is_pre_election: true
I20260812 11:08:53.236546 12318 raft_consensus.cc:2454] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a92247488e4614842d1be3090e17d2 in term 0.
I20260812 11:08:53.236579 12537 raft_consensus.cc:2454] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a92247488e4614842d1be3090e17d2 in term 0.
I20260812 11:08:53.237054 12657 leader_election.cc:302] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a92247488e4614842d1be3090e17d2, 3f24c8d8577f4706b0300e27a437126d; no voters:
I20260812 11:08:53.237396 12877 raft_consensus.cc:2781] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:08:53.237486 12877 raft_consensus.cc:482] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:08:53.237520 12877 raft_consensus.cc:3037] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:08:53.238605 12877 raft_consensus.cc:504] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } } peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } }
I20260812 11:08:53.238963 12877 leader_election.cc:288] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [CANDIDATE]: Term 1 election: Requested vote from peers 84eba57166ea4175adf9ae193e3bb951 (127.18.174.193:33237), 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433)
I20260812 11:08:53.239414 12318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0935daa7d8954ac1ba6514c0e19e821e" candidate_uuid: "17a92247488e4614842d1be3090e17d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84eba57166ea4175adf9ae193e3bb951"
I20260812 11:08:53.239408 12537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0935daa7d8954ac1ba6514c0e19e821e" candidate_uuid: "17a92247488e4614842d1be3090e17d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f24c8d8577f4706b0300e27a437126d"
I20260812 11:08:53.239543 12537 raft_consensus.cc:3037] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:08:53.239538 12318 raft_consensus.cc:3037] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951 [term 0 FOLLOWER]: Advancing to term 1
W20260812 11:08:53.240123 12845 tablet.cc:2369] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:08:53.240746 12318 raft_consensus.cc:2454] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a92247488e4614842d1be3090e17d2 in term 1.
I20260812 11:08:53.240924 12537 raft_consensus.cc:2454] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a92247488e4614842d1be3090e17d2 in term 1.
I20260812 11:08:53.241089 12657 leader_election.cc:302] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a92247488e4614842d1be3090e17d2, 84eba57166ea4175adf9ae193e3bb951; no voters:
I20260812 11:08:53.241276 12877 raft_consensus.cc:2781] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:08:53.241532 12877 raft_consensus.cc:686] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [term 1 LEADER]: Becoming Leader. State: Replica: 17a92247488e4614842d1be3090e17d2, State: Running, Role: LEADER
I20260812 11:08:53.241863 12877 consensus_queue.cc:237] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } } peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } }
I20260812 11:08:53.245527 12068 catalog_manager.cc:5495] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17a92247488e4614842d1be3090e17d2 (127.18.174.195). New cstate: current_term: 1 leader_uuid: "17a92247488e4614842d1be3090e17d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } health_report { overall_health: HEALTHY } } }
W20260812 11:08:53.257745 12613 tablet.cc:2369] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:08:53.280308 12867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.276659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56360 (local address 127.18.174.195:32889)
0812 11:08:53.276777 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:53.276780 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:53.276794 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:08:53.276975 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:53.276978 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:53.277037 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:53.277135 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:08:53.277348 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.277851 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.278750 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.278983 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.279066 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.279348 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:08:53.279827 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:08:53.279921 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:53.280056 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 11:08:53.280161 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260812 11:08:53.283761 12388 tablet.cc:2369] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:08:53.287532 12318 raft_consensus.cc:1261] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Refusing update from remote peer 17a92247488e4614842d1be3090e17d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:08:53.287532 12537 raft_consensus.cc:1261] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d [term 1 FOLLOWER]: Refusing update from remote peer 17a92247488e4614842d1be3090e17d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:08:53.288347 12877 consensus_queue.cc:1035] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:08:53.288600 12881 consensus_queue.cc:1035] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:08:53.306331 12071 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47948:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:08:53.306545 12071 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47948:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:08:53.309425 12071 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: Sending DeleteTablet for 3 replicas of tablet 0935daa7d8954ac1ba6514c0e19e821e
I20260812 11:08:53.310345 12500 tablet_service.cc:1514] Processing DeleteTablet for tablet 0935daa7d8954ac1ba6514c0e19e821e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:08:53 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:52062
I20260812 11:08:53.310318 12736 tablet_service.cc:1514] Processing DeleteTablet for tablet 0935daa7d8954ac1ba6514c0e19e821e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:08:53 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:56352
I20260812 11:08:53.310365 12289 tablet_service.cc:1514] Processing DeleteTablet for tablet 0935daa7d8954ac1ba6514c0e19e821e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:08:53 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:55200
I20260812 11:08:53.310920 12907 tablet_replica.cc:330] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: stopping tablet replica
I20260812 11:08:53.311120 12904 tablet_replica.cc:330] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d: stopping tablet replica
I20260812 11:08:53.311239 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 12180
I20260812 11:08:53.311470 12904 raft_consensus.cc:2229] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:08:53.321743 12904 raft_consensus.cc:2258] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:08:53.324800 12904 ts_tablet_manager.cc:1905] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:08:53.327386 12904 ts_tablet_manager.cc:1918] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:08:53.327503 12904 log.cc:1196] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/0935daa7d8954ac1ba6514c0e19e821e
I20260812 11:08:53.327777 12904 ts_tablet_manager.cc:1939] T 0935daa7d8954ac1ba6514c0e19e821e P 3f24c8d8577f4706b0300e27a437126d: Deleting consensus metadata
I20260812 11:08:53.329192 12905 tablet_replica.cc:330] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2: stopping tablet replica
I20260812 11:08:53.329182 12046 catalog_manager.cc:4841] TS 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433): tablet 0935daa7d8954ac1ba6514c0e19e821e (table test-table [id=c273214d99f845c8865695c01b448e24]) successfully deleted
I20260812 11:08:53.329584 12905 raft_consensus.cc:2229] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:08:53.330003 12905 raft_consensus.cc:2258] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:08:53.331387 12905 ts_tablet_manager.cc:1905] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 11:08:53.333200 12046 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:33237 (error 108)
I20260812 11:08:53.333508 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 12395
I20260812 11:08:53.334506 12865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.334182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:33237 (local address 127.0.0.1:55216)
0812 11:08:53.334349 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:53.334419 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:33237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
W20260812 11:08:53.334651 12046 catalog_manager.cc:4584] TS 84eba57166ea4175adf9ae193e3bb951 (127.18.174.193:33237): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0935daa7d8954ac1ba6514c0e19e821e: Network error: Client connection negotiation failed: client connection to 127.18.174.193:33237: connect: Connection refused (error 111)
I20260812 11:08:53.337291 12905 ts_tablet_manager.cc:1918] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:08:53.337443 12905 log.cc:1196] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/0935daa7d8954ac1ba6514c0e19e821e
I20260812 11:08:53.337862 12905 ts_tablet_manager.cc:1939] T 0935daa7d8954ac1ba6514c0e19e821e P 17a92247488e4614842d1be3090e17d2: Deleting consensus metadata
I20260812 11:08:53.339452 12041 catalog_manager.cc:4841] TS 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889): tablet 0935daa7d8954ac1ba6514c0e19e821e (table test-table [id=c273214d99f845c8865695c01b448e24]) successfully deleted
I20260812 11:08:53.350397 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 12622
I20260812 11:08:53.368335 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 12019
I20260812 11:08:53.378708 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45957
--webserver_interface=127.18.174.254
--webserver_port=43051
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:41839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:45957
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:08:53.496376 12910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:53.496672 12910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:53.496713 12910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:53.500907 12910 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:08:53.500982 12910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:53.501000 12910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:53.501017 12910 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:08:53.501047 12910 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:08:53.506629 12910 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:41839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:45957
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=43051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:53.507822 12910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:53.508936 12910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:08:53.523883 12910 server_base.cc:1034] running on GCE node
W20260812 11:08:53.523854 12918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:53.523825 12924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:53.523833 12917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:53.524757 12910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:53.526036 12910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:53.527194 12910 hybrid_clock.cc:648] HybridClock initialized: now 1786532933527164 us; error 45 us; skew 500 ppm
Aug 12 11:08:53 dist-test-slave-lgr5 krb5kdc[11999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532933, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:53.530057 12910 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:08:53.531077 12910 webserver.cc:460] Webserver started at http://127.18.174.254:43051/ using document root <none> and password file <none>
I20260812 11:08:53.531642 12910 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:53.531718 12910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:53.535846 12910 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:08:53.538232 12934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:53.539712 12910 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 11:08:53.539846 12910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "9fe816679c8442bb913a396c46ad863f"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "863ead4723a76190c743ceb1f2b1fab1"
server_key_iv: "5a58c524d066ef26a0fc9b4bc9a27e82"
server_key_version: "encryptionkey@0"
I20260812 11:08:53.540563 12910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:53.552707 12910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:53.556061 12910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:53.556296 12910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:53.563449 12910 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:45957
I20260812 11:08:53.563730 13021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:45957 every 8 connection(s)
I20260812 11:08:53.564697 12910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:08:53.566149 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 12910
I20260812 11:08:53.566617 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:33237
--local_ip_for_outbound_sockets=127.18.174.193
--tserver_master_addrs=127.18.174.254:45957
--webserver_port=37733
--webserver_interface=127.18.174.193
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:41839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:08:53.569655 13022 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:08:53.571497 13022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: Bootstrap starting.
I20260812 11:08:53.589004 13022 log.cc:824] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:53.598150 13022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:08:53.598517 13022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: Bootstrap complete.
I20260812 11:08:53.602622 13022 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } }
I20260812 11:08:53.603053 13022 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe816679c8442bb913a396c46ad863f, State: Initialized, Role: FOLLOWER
I20260812 11:08:53.603566 13022 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } }
I20260812 11:08:53.603701 13022 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:08:53.603777 13022 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:08:53.603878 13022 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:08:53.605898 13022 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } }
I20260812 11:08:53.606251 13022 leader_election.cc:302] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fe816679c8442bb913a396c46ad863f; no voters:
I20260812 11:08:53.606585 13022 leader_election.cc:288] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:08:53.606686 13027 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:08:53.606889 13027 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 2 LEADER]: Becoming Leader. State: Replica: 9fe816679c8442bb913a396c46ad863f, State: Running, Role: LEADER
I20260812 11:08:53.607199 13027 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } }
I20260812 11:08:53.607899 13022 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:08:53.608613 13029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9fe816679c8442bb913a396c46ad863f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } } }
I20260812 11:08:53.608752 13029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [sys.catalog]: This master's current role is: LEADER
I20260812 11:08:53.609063 13030 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fe816679c8442bb913a396c46ad863f. Latest consensus state: current_term: 2 leader_uuid: "9fe816679c8442bb913a396c46ad863f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } } }
I20260812 11:08:53.609150 13030 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [sys.catalog]: This master's current role is: LEADER
I20260812 11:08:53.609746 13037 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:08:53.614661 13037 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:08:53.615412 13037 catalog_manager.cc:1259] Loaded cluster ID: 79d119f157df47f488e38806e530a260
I20260812 11:08:53.615490 13037 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:08:53.617002 13037 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 11:08:53.621778 13037 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 11:08:53.627732 13037 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:08:53.628702 13037 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: Loaded TSK: 0
I20260812 11:08:53.630026 13037 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:08:53.688953 13024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:53.689241 13024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:53.689303 13024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:53.693434 13024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:53.693500 13024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:53.693583 13024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:08:53.699007 13024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:41839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:33237
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=37733
--tserver_master_addrs=127.18.174.254:45957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:53.700107 13024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:53.701243 13024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:53.712241 13071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:53.712244 13074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:53.712532 13072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:53.712534 13024 server_base.cc:1034] running on GCE node
I20260812 11:08:53.713063 13024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:53.713804 13024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:53.714986 13024 hybrid_clock.cc:648] HybridClock initialized: now 1786532933714947 us; error 55 us; skew 500 ppm
Aug 12 11:08:53 dist-test-slave-lgr5 krb5kdc[11999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532933, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:53.717967 13024 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:08:53.718990 13024 webserver.cc:460] Webserver started at http://127.18.174.193:37733/ using document root <none> and password file <none>
I20260812 11:08:53.719718 13024 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:53.719828 13024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:53.723848 13024 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:08:53.726161 13091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:53.727582 13024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 11:08:53.727705 13024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "84eba57166ea4175adf9ae193e3bb951"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "27351dd656b987364197be08ea1245b8"
server_key_iv: "998659f6eaec86237535626ad7095c70"
server_key_version: "encryptionkey@0"
I20260812 11:08:53.728322 13024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:53.756376 13024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:53.759804 13024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:53.760011 13024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:53.760707 13024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:08:53.761898 13100 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 11:08:53.766433 13024 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 11:08:53.766511 13024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260812 11:08:53.766587 13024 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 11:08:53.768393 13024 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 11:08:53.768447 13024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260812 11:08:53.768741 13100 tablet_bootstrap.cc:492] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: Bootstrap starting.
I20260812 11:08:53.778427 13024 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:33237
I20260812 11:08:53.778496 13294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:33237 every 8 connection(s)
I20260812 11:08:53.779459 13024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:08:53.784770 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 13024
I20260812 11:08:53.785277 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:33433
--local_ip_for_outbound_sockets=127.18.174.194
--tserver_master_addrs=127.18.174.254:45957
--webserver_port=37801
--webserver_interface=127.18.174.194
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:41839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:08:53.788156 13100 log.cc:824] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:08:53 dist-test-slave-lgr5 krb5kdc[11999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532933, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:53.796751 13100 tablet_bootstrap.cc:492] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:08:53.797150 13100 tablet_bootstrap.cc:492] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: Bootstrap complete.
I20260812 11:08:53.798413 13100 ts_tablet_manager.cc:1397] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: Time spent bootstrapping tablet: real 0.030s user 0.011s sys 0.017s
I20260812 11:08:53.799206 13302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.781911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:54647 (local address 127.18.174.254:45957)
0812 11:08:53.782409 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:53.782431 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:53.782593 (+ 162us) server_negotiation.cc:407] Connection header received
0812 11:08:53.784190 (+ 1597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:53.784203 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:53.784546 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:53.784987 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:53.786203 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.787373 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.788976 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.789632 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.789812 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.793009 (+ 3197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:53.793017 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:53.793038 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:53.793080 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:53.795328 (+ 2248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:53.796013 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:53.796022 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:53.796028 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:53.796251 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:53.796660 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:53.796664 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:53.796666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:53.797215 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:53.797371 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:53.798010 (+ 639us) server_negotiation.cc:299] Negotiation successful
0812 11:08:53.798335 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":115,"threads_started":1}
I20260812 11:08:53.799578 13301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.781754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:54647)
0812 11:08:53.782390 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:53.782457 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:53.783669 (+ 1212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:53.784971 (+ 1302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:53.784979 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:53.785520 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:53.786024 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.786040 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.787555 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.787559 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.788835 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.788851 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.789809 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.789814 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.790053 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.790761 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:53.790783 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:53.792738 (+ 1955us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:53.795489 (+ 2751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:53.795495 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:53.795508 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:53.795870 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:53.796364 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:53.796368 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:53.796370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:53.796554 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:53.797348 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:53.797355 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:53.797648 (+ 293us) client_negotiation.cc:769] Sending connection context
0812 11:08:53.797845 (+ 197us) client_negotiation.cc:240] Negotiation successful
0812 11:08:53.798189 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":169,"threads_started":1}
I20260812 11:08:53.801501 13100 raft_consensus.cc:348] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } } peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } }
I20260812 11:08:53.802042 13100 raft_consensus.cc:729] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84eba57166ea4175adf9ae193e3bb951, State: Initialized, Role: FOLLOWER
I20260812 11:08:53.802515 13296 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45957
I20260812 11:08:53.802549 13100 consensus_queue.cc:260] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } } peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } }
I20260812 11:08:53.802752 13296 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:53.803332 13296 heartbeater.cc:511] Master 127.18.174.254:45957 requested a full tablet report, sending...
I20260812 11:08:53.803613 13100 ts_tablet_manager.cc:1428] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: Time spent starting tablet: real 0.005s user 0.006s sys 0.001s
I20260812 11:08:53.805871 12959 ts_manager.cc:194] Registered new tserver with Master: 84eba57166ea4175adf9ae193e3bb951 (127.18.174.193:33237)
I20260812 11:08:53.810138 12959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:54647
I20260812 11:08:53.813045 13296 heartbeater.cc:503] Master 127.18.174.254:45957 was elected leader, sending a full tablet report...
Aug 12 11:08:53 dist-test-slave-lgr5 krb5kdc[11999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532933, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for kudu/127.18.174.193@KRBTEST.COM
I20260812 11:08:53.820493 13309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.808704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:33237 (local address 127.0.0.1:55224)
0812 11:08:53.809120 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:53.809169 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:53.809330 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:53.810224 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:53.810231 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:53.810664 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:53.810811 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.810821 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.812410 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.812415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.813356 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.813394 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.814209 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.814213 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.814332 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.814911 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:53.814927 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:53.816504 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:53.818703 (+ 2199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:53.818712 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:53.818717 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:53.818980 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:53.819286 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:53.819289 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:53.819290 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:53.819390 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:53.819888 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:53.819893 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:53.820010 (+ 117us) client_negotiation.cc:769] Sending connection context
0812 11:08:53.820172 (+ 162us) client_negotiation.cc:240] Negotiation successful
0812 11:08:53.820355 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":97,"threads_started":1}
I20260812 11:08:53.820851 13310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.809393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55224 (local address 127.18.174.193:33237)
0812 11:08:53.809718 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:53.809734 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:53.809759 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:08:53.809831 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:53.809837 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:53.810055 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:53.810187 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:53.811064 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.812224 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.813516 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.814023 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.814188 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.816649 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:53.816660 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:53.816675 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:53.816705 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:53.818580 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:53.819089 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:53.819095 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:53.819097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:53.819196 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:53.819467 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:53.819470 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:53.819472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:53.819779 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:53.819921 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:53.820261 (+ 340us) server_negotiation.cc:299] Negotiation successful
0812 11:08:53.820447 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":107,"threads_started":1}
I20260812 11:08:53.821887 13173 tablet_service.cc:1514] Processing DeleteTablet for tablet 0935daa7d8954ac1ba6514c0e19e821e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:08:53 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:55224
I20260812 11:08:53.822744 13312 tablet_replica.cc:330] stopping tablet replica
I20260812 11:08:53.823033 13312 raft_consensus.cc:2229] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:08:53.823273 13312 raft_consensus.cc:2258] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:08:53.824291 13312 ts_tablet_manager.cc:1905] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:08:53.827867 13312 ts_tablet_manager.cc:1918] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:08:53.827963 13312 log.cc:1196] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal/wals/0935daa7d8954ac1ba6514c0e19e821e
I20260812 11:08:53.828228 13312 ts_tablet_manager.cc:1939] T 0935daa7d8954ac1ba6514c0e19e821e P 84eba57166ea4175adf9ae193e3bb951: Deleting consensus metadata
I20260812 11:08:53.829909 12938 catalog_manager.cc:4841] TS 84eba57166ea4175adf9ae193e3bb951 (127.18.174.193:33237): tablet 0935daa7d8954ac1ba6514c0e19e821e (table test-table [id=c273214d99f845c8865695c01b448e24]) successfully deleted
W20260812 11:08:53.909281 13303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:53.909550 13303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:53.909600 13303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:53.913740 13303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:53.913811 13303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:53.913883 13303 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:08:53.919495 13303 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:41839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:33433
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=37801
--tserver_master_addrs=127.18.174.254:45957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:53.920786 13303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:53.921842 13303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:53.932319 13325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:53.932423 13303 server_base.cc:1034] running on GCE node
W20260812 11:08:53.932296 13327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:53.932302 13323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:53.933138 13303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:53.933810 13303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:53.934968 13303 hybrid_clock.cc:648] HybridClock initialized: now 1786532933934939 us; error 45 us; skew 500 ppm
Aug 12 11:08:53 dist-test-slave-lgr5 krb5kdc[11999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532933, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:53.937856 13303 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:08:53.938809 13303 webserver.cc:460] Webserver started at http://127.18.174.194:37801/ using document root <none> and password file <none>
I20260812 11:08:53.939386 13303 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:53.939469 13303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:53.943531 13303 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:08:53.945931 13336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:53.947223 13303 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:08:53.947343 13303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "3f24c8d8577f4706b0300e27a437126d"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "1893657d4c92aa8bde58420e56daf29c"
server_key_iv: "75cbac8bc273deef40929be058b87fa4"
server_key_version: "encryptionkey@0"
I20260812 11:08:53.947929 13303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:53.965483 13303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:53.968447 13303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:53.968621 13303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:53.969183 13303 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:08:53.970046 13303 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:08:53.970094 13303 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:53.970135 13303 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:08:53.970155 13303 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:53.980669 13303 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:33433
I20260812 11:08:53.980819 13531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:33433 every 8 connection(s)
I20260812 11:08:53.982045 13303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:08:53.983558 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 13303
I20260812 11:08:53.984009 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:32889
--local_ip_for_outbound_sockets=127.18.174.195
--tserver_master_addrs=127.18.174.254:45957
--webserver_port=33443
--webserver_interface=127.18.174.195
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:41839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:08:53 dist-test-slave-lgr5 krb5kdc[11999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532933, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:53.999955 13302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.988458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:58735 (local address 127.18.174.254:45957)
0812 11:08:53.988618 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:53.988623 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:53.988646 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:08:53.989739 (+ 1093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:53.989743 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:53.989815 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:53.989901 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:53.991228 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.991764 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.993033 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.993276 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.993379 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.996233 (+ 2854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:53.996236 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:53.996239 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:53.996268 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:53.997740 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:53.998304 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:53.998308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:53.998309 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:53.998395 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:53.998747 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:53.998750 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:53.998751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:53.998959 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:53.999048 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:53.999615 (+ 567us) server_negotiation.cc:299] Negotiation successful
0812 11:08:53.999768 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:08:54.000895 13537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:53.987198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:58735)
0812 11:08:53.987919 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:53.987981 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:53.989489 (+ 1508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:53.990120 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:53.990128 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:53.990517 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:53.991061 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.991077 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.991900 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.991903 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.992898 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:53.992909 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:53.993437 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:53.993442 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:53.993624 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:53.994286 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:53.994304 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:53.996027 (+ 1723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:53.997883 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:53.997890 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:53.997910 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:53.998188 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:53.998483 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:53.998486 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:53.998489 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:53.998644 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:53.999066 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:53.999073 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:53.999345 (+ 272us) client_negotiation.cc:769] Sending connection context
0812 11:08:53.999536 (+ 191us) client_negotiation.cc:240] Negotiation successful
0812 11:08:53.999897 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":208,"threads_started":1}
I20260812 11:08:54.002345 13533 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45957
I20260812 11:08:54.002648 13533 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:54.003298 13533 heartbeater.cc:511] Master 127.18.174.254:45957 requested a full tablet report, sending...
I20260812 11:08:54.004633 12959 ts_manager.cc:194] Registered new tserver with Master: 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433)
I20260812 11:08:54.005470 12959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:58735
W20260812 11:08:54.107362 13536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:54.107693 13536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:54.107743 13536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:54.112282 13536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:54.112358 13536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:54.112434 13536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:08:54.118031 13536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:41839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:32889
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=33443
--tserver_master_addrs=127.18.174.254:45957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:54.119133 13536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:54.120199 13536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:54.130925 13546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:54.130686 13547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:54.130686 13552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:54.131717 13536 server_base.cc:1034] running on GCE node
I20260812 11:08:54.132300 13536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:54.133172 13536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:54.134397 13536 hybrid_clock.cc:648] HybridClock initialized: now 1786532934134361 us; error 50 us; skew 500 ppm
Aug 12 11:08:54 dist-test-slave-lgr5 krb5kdc[11999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532934, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:54.137324 13536 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:08:54.138274 13536 webserver.cc:460] Webserver started at http://127.18.174.195:33443/ using document root <none> and password file <none>
I20260812 11:08:54.138850 13536 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:54.138923 13536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:54.143224 13536 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:08:54.145637 13565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:54.146991 13536 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:08:54.147101 13536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "17a92247488e4614842d1be3090e17d2"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "1f0e44ad1fcc98b4218967979170f805"
server_key_iv: "76d200269e3e3b04a1a1d98cfbacb5d8"
server_key_version: "encryptionkey@0"
I20260812 11:08:54.147688 13536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:54.189193 13536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:54.192525 13536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:54.192693 13536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:54.193276 13536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:08:54.194233 13536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:08:54.194285 13536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:54.194351 13536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:08:54.194376 13536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:54.203402 13536 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:32889
I20260812 11:08:54.203446 13758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:32889 every 8 connection(s)
I20260812 11:08:54.204589 13536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:08:54.214237 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 13536
Aug 12 11:08:54 dist-test-slave-lgr5 krb5kdc[11999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532934, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:08:54.220240 13302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:54.206489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:43973 (local address 127.18.174.254:45957)
0812 11:08:54.206619 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:54.206622 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:54.207546 (+ 924us) server_negotiation.cc:407] Connection header received
0812 11:08:54.209111 (+ 1565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:54.209115 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:54.209169 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:54.209272 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:54.210535 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.211076 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.212320 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.212548 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.212627 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:54.215385 (+ 2758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:54.215389 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:54.215391 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:54.215418 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:54.217108 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:54.218487 (+ 1379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:54.218490 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:54.218491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:54.218565 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:54.218961 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:54.218964 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:54.218965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:54.219142 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:54.219217 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:54.219917 (+ 700us) server_negotiation.cc:299] Negotiation successful
0812 11:08:54.220040 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:08:54.221195 13764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:54.206875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:43973)
0812 11:08:54.207359 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:54.207404 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:54.208836 (+ 1432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:54.209425 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:54.209432 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:54.209851 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:54.210378 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:54.210392 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.211219 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.211222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:54.212212 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:54.212224 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.212683 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.212686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:54.212865 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:54.213493 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:54.213510 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:54.215178 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:54.218033 (+ 2855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:54.218039 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:54.218054 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:54.218384 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:54.218657 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:54.218661 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:54.218662 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:54.218853 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:54.219248 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:54.219257 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:54.219637 (+ 380us) client_negotiation.cc:769] Sending connection context
0812 11:08:54.219839 (+ 202us) client_negotiation.cc:240] Negotiation successful
0812 11:08:54.220213 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":118,"threads_started":1}
I20260812 11:08:54.222494 13759 heartbeater.cc:347] Connected to a master server at 127.18.174.254:45957
I20260812 11:08:54.222793 13759 heartbeater.cc:464] Registering TS with master...
I20260812 11:08:54.223104 13766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:54.214952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47962 (local address 127.18.174.254:45957)
0812 11:08:54.215265 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:54.215270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:54.215318 (+ 48us) server_negotiation.cc:407] Connection header received
0812 11:08:54.215447 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:54.215450 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:54.215495 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:54.215584 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:54.216310 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.217108 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.218004 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.218221 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.218295 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:54.219715 (+ 1420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:54.219718 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:54.219720 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:54.219742 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:54.221387 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:54.221871 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:54.221874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:54.221875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:54.221972 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:54.222236 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:54.222239 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:54.222241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:54.222453 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:54.222656 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:54.222846 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 11:08:54.222971 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":100,"threads_started":1}
I20260812 11:08:54.223430 13759 heartbeater.cc:511] Master 127.18.174.254:45957 requested a full tablet report, sending...
I20260812 11:08:54.224560 12960 ts_manager.cc:194] Registered new tserver with Master: 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889)
I20260812 11:08:54.225122 12960 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:43973
I20260812 11:08:54.237138 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:08:54.241914 13766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:54.237885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47970 (local address 127.18.174.254:45957)
0812 11:08:54.238045 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:54.238050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:54.238187 (+ 137us) server_negotiation.cc:407] Connection header received
0812 11:08:54.238394 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:54.238397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:54.238516 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:54.238619 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:08:54.238879 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.239406 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.240417 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.240648 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.240742 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:54.241078 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:08:54.241518 (+ 440us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:08:54.241632 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:54.241704 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 11:08:54.241770 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:08:54.242637 12960 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:47970:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:08:54.246104 12960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:08:54.254318 13173 tablet_service.cc:1467] Processing CreateTablet for tablet 5bd6d24f73f9485684e0cb71f8dbf46c (DEFAULT_TABLE table=test-table [id=f8020e02247d4c55996bfc884ac38bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:08:54.255080 13173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bd6d24f73f9485684e0cb71f8dbf46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:08:54.257831 13100 tablet_bootstrap.cc:492] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951: Bootstrap starting.
I20260812 11:08:54.258773 13100 tablet_bootstrap.cc:654] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951: Neither blocks nor log segments found. Creating new log.
I20260812 11:08:54.259343 13309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:54.253188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:33433 (local address 127.0.0.1:52074)
0812 11:08:54.253310 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:54.253326 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:54.253399 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:54.254341 (+ 942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:54.254345 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:54.254365 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:08:54.254478 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:54.254486 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.256427 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.256430 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:54.257607 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:54.257620 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.258824 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.258828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:54.258939 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:54.259001 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 11:08:54.259100 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 11:08:54.259200 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":29}
I20260812 11:08:54.259389 13776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:54.253377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52074 (local address 127.18.174.194:33433)
0812 11:08:54.253786 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:54.253799 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:54.253823 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:08:54.253906 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:54.253912 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:54.254166 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:54.254802 (+ 636us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:08:54.255139 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.256303 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.257757 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.258660 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.258862 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:54.259025 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:54.259136 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 11:08:54.259239 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":174,"threads_started":1}
I20260812 11:08:54.260236 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:54.253676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:32889 (local address 127.0.0.1:56368)
0812 11:08:54.253925 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:54.253937 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:54.254032 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:54.254867 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:54.254870 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:54.254890 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:08:54.254986 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:54.254992 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.256272 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.256276 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:54.257616 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:54.257623 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.259846 (+ 2223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.259850 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:54.259945 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:54.259972 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 11:08:54.260023 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 11:08:54.260106 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":29,"thread_start_us":99,"threads_started":1}
I20260812 11:08:54.260412 13100 tablet_bootstrap.cc:492] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951: No bootstrap required, opened a new log
I20260812 11:08:54.260524 13100 ts_tablet_manager.cc:1397] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260812 11:08:54.260941 13100 raft_consensus.cc:348] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
I20260812 11:08:54.261061 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:54.254081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56368 (local address 127.18.174.195:32889)
0812 11:08:54.254411 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:54.254422 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:54.254445 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:08:54.254506 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:54.254509 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:54.254693 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:54.255159 (+ 466us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:08:54.255316 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.256140 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.258467 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.259704 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.260617 (+ 913us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:54.260754 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:54.260807 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 11:08:54.260904 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":140,"threads_started":1}
I20260812 11:08:54.261081 13100 raft_consensus.cc:374] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:08:54.261125 13100 raft_consensus.cc:729] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84eba57166ea4175adf9ae193e3bb951, State: Initialized, Role: FOLLOWER
I20260812 11:08:54.261261 13100 consensus_queue.cc:260] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
I20260812 11:08:54.261520 13100 ts_tablet_manager.cc:1428] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:08:54.262935 13410 tablet_service.cc:1467] Processing CreateTablet for tablet 5bd6d24f73f9485684e0cb71f8dbf46c (DEFAULT_TABLE table=test-table [id=f8020e02247d4c55996bfc884ac38bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:08:54.264165 13410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bd6d24f73f9485684e0cb71f8dbf46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:08:54.263877 13647 tablet_service.cc:1467] Processing CreateTablet for tablet 5bd6d24f73f9485684e0cb71f8dbf46c (DEFAULT_TABLE table=test-table [id=f8020e02247d4c55996bfc884ac38bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:08:54.264935 13647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bd6d24f73f9485684e0cb71f8dbf46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:08:54.271590 13784 tablet_bootstrap.cc:492] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d: Bootstrap starting.
I20260812 11:08:54.272149 13786 tablet_bootstrap.cc:492] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2: Bootstrap starting.
I20260812 11:08:54.274447 13784 tablet_bootstrap.cc:654] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d: Neither blocks nor log segments found. Creating new log.
I20260812 11:08:54.274782 13786 tablet_bootstrap.cc:654] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2: Neither blocks nor log segments found. Creating new log.
I20260812 11:08:54.275269 13784 log.cc:824] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:54.275518 13786 log.cc:824] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:54.277245 13784 tablet_bootstrap.cc:492] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d: No bootstrap required, opened a new log
I20260812 11:08:54.277297 13786 tablet_bootstrap.cc:492] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2: No bootstrap required, opened a new log
I20260812 11:08:54.277451 13784 ts_tablet_manager.cc:1397] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:08:54.277479 13786 ts_tablet_manager.cc:1397] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
W20260812 11:08:54.280803 13297 tablet.cc:2369] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:08:54.280771 13786 raft_consensus.cc:348] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
I20260812 11:08:54.280766 13784 raft_consensus.cc:348] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
I20260812 11:08:54.281054 13786 raft_consensus.cc:374] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:08:54.281052 13784 raft_consensus.cc:374] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:08:54.281111 13784 raft_consensus.cc:729] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f24c8d8577f4706b0300e27a437126d, State: Initialized, Role: FOLLOWER
I20260812 11:08:54.281111 13786 raft_consensus.cc:729] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a92247488e4614842d1be3090e17d2, State: Initialized, Role: FOLLOWER
I20260812 11:08:54.281553 13784 consensus_queue.cc:260] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
I20260812 11:08:54.281553 13786 consensus_queue.cc:260] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
I20260812 11:08:54.282275 13533 heartbeater.cc:503] Master 127.18.174.254:45957 was elected leader, sending a full tablet report...
I20260812 11:08:54.282563 13786 ts_tablet_manager.cc:1428] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 11:08:54.282564 13784 ts_tablet_manager.cc:1428] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 11:08:54.282784 13759 heartbeater.cc:503] Master 127.18.174.254:45957 was elected leader, sending a full tablet report...
W20260812 11:08:54.455564 13760 tablet.cc:2369] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:08:54.469498 13790 raft_consensus.cc:482] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:08:54.469733 13790 raft_consensus.cc:504] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
I20260812 11:08:54.470965 13790 leader_election.cc:288] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889), 84eba57166ea4175adf9ae193e3bb951 (127.18.174.193:33237)
I20260812 11:08:54.476220 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:54.471368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:60889 (local address 127.18.174.195:32889)
0812 11:08:54.471510 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:54.471515 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:54.471604 (+ 89us) server_negotiation.cc:407] Connection header received
0812 11:08:54.471783 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:54.471787 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:54.471846 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:54.471970 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:08:54.472359 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.473167 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.474958 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.475576 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.475715 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:54.475775 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:54.475987 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 11:08:54.476062 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:08:54.476222 13793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:54.471422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:55545 (local address 127.18.174.193:33237)
0812 11:08:54.471779 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:54.471783 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:54.471796 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:08:54.471883 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:54.471886 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:54.471952 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:54.472066 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:08:54.472356 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.473167 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.474958 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.475646 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.475752 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:54.475906 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:54.475983 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 11:08:54.476061 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":164,"threads_started":1}
I20260812 11:08:54.476225 13537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:54.471283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:32889 (local address 127.18.174.194:60889)
0812 11:08:54.471499 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:54.471522 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:54.471646 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:54.471999 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:54.472001 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:54.472018 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:08:54.472217 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:54.472226 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.473290 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.473293 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:54.474819 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:54.474833 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.475701 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.475704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:54.475829 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:54.475876 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 11:08:54.475954 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 11:08:54.476042 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":167}
I20260812 11:08:54.476233 13792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:54.471314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:33237 (local address 127.18.174.194:55545)
0812 11:08:54.471711 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:54.471725 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:54.471804 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:54.472108 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:54.472111 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:54.472124 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:08:54.472237 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:54.472243 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.473290 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.473293 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:54.474820 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:54.474833 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.475757 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.475760 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:54.475884 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:54.475904 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:08:54.475964 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 11:08:54.476040 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":166,"thread_start_us":89,"threads_started":1}
I20260812 11:08:54.476913 13684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bd6d24f73f9485684e0cb71f8dbf46c" candidate_uuid: "3f24c8d8577f4706b0300e27a437126d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a92247488e4614842d1be3090e17d2" is_pre_election: true
I20260812 11:08:54.476902 13203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bd6d24f73f9485684e0cb71f8dbf46c" candidate_uuid: "3f24c8d8577f4706b0300e27a437126d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84eba57166ea4175adf9ae193e3bb951" is_pre_election: true
I20260812 11:08:54.477218 13203 raft_consensus.cc:2454] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f24c8d8577f4706b0300e27a437126d in term 0.
I20260812 11:08:54.477229 13684 raft_consensus.cc:2454] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f24c8d8577f4706b0300e27a437126d in term 0.
I20260812 11:08:54.477725 13340 leader_election.cc:302] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 17a92247488e4614842d1be3090e17d2, 3f24c8d8577f4706b0300e27a437126d, 84eba57166ea4175adf9ae193e3bb951; no voters:
I20260812 11:08:54.478014 13790 raft_consensus.cc:2781] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:08:54.478098 13790 raft_consensus.cc:482] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:08:54.478129 13790 raft_consensus.cc:3037] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:08:54.479307 13790 raft_consensus.cc:504] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
I20260812 11:08:54.479712 13790 leader_election.cc:288] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [CANDIDATE]: Term 1 election: Requested vote from peers 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889), 84eba57166ea4175adf9ae193e3bb951 (127.18.174.193:33237)
I20260812 11:08:54.480159 13684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bd6d24f73f9485684e0cb71f8dbf46c" candidate_uuid: "3f24c8d8577f4706b0300e27a437126d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a92247488e4614842d1be3090e17d2"
I20260812 11:08:54.480208 13203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bd6d24f73f9485684e0cb71f8dbf46c" candidate_uuid: "3f24c8d8577f4706b0300e27a437126d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84eba57166ea4175adf9ae193e3bb951"
I20260812 11:08:54.480325 13684 raft_consensus.cc:3037] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:08:54.480330 13203 raft_consensus.cc:3037] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:08:54.481344 13203 raft_consensus.cc:2454] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f24c8d8577f4706b0300e27a437126d in term 1.
I20260812 11:08:54.481402 13684 raft_consensus.cc:2454] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f24c8d8577f4706b0300e27a437126d in term 1.
I20260812 11:08:54.481657 13340 leader_election.cc:302] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f24c8d8577f4706b0300e27a437126d, 84eba57166ea4175adf9ae193e3bb951; no voters:
I20260812 11:08:54.481850 13790 raft_consensus.cc:2781] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:08:54.482074 13790 raft_consensus.cc:686] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [term 1 LEADER]: Becoming Leader. State: Replica: 3f24c8d8577f4706b0300e27a437126d, State: Running, Role: LEADER
I20260812 11:08:54.482405 13790 consensus_queue.cc:237] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
W20260812 11:08:54.486063 13535 tablet.cc:2369] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:08:54.485961 12959 catalog_manager.cc:5495] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f24c8d8577f4706b0300e27a437126d (127.18.174.194). New cstate: current_term: 1 leader_uuid: "3f24c8d8577f4706b0300e27a437126d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } health_report { overall_health: UNKNOWN } } }
I20260812 11:08:54.501569 13776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:54.498028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52076 (local address 127.18.174.194:33433)
0812 11:08:54.498159 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:54.498163 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:54.498201 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:08:54.498281 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:54.498283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:54.498343 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:54.498424 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:08:54.498692 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.499218 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.500129 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:54.500358 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:54.500438 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:54.500726 (+ 288us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:08:54.501209 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:08:54.501303 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:54.501389 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 11:08:54.501449 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:08:54.507728 13684 raft_consensus.cc:1261] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2 [term 1 FOLLOWER]: Refusing update from remote peer 3f24c8d8577f4706b0300e27a437126d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:08:54.507725 13203 raft_consensus.cc:1261] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Refusing update from remote peer 3f24c8d8577f4706b0300e27a437126d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:08:54.508628 13795 consensus_queue.cc:1035] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:08:54.508836 13790 consensus_queue.cc:1035] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [LEADER]: Connected to new peer: Peer: permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:08:54.517927 13810 mvcc.cc:205] Tried to move back new op lower bound from 7317638899736027136 to 7317638899642728448. Current Snapshot: MvccSnapshot[applied={T|T < 7317638899736027136 or (T in {7317638899736027136})}]
I20260812 11:08:54.524947 12959 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:47970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:08:54.525152 12959 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:47970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:08:54.527704 12959 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: Sending DeleteTablet for 3 replicas of tablet 5bd6d24f73f9485684e0cb71f8dbf46c
I20260812 11:08:54.528496 13410 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bd6d24f73f9485684e0cb71f8dbf46c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:08:54 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:52074
I20260812 11:08:54.528519 13647 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bd6d24f73f9485684e0cb71f8dbf46c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:08:54 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:56368
I20260812 11:08:54.528664 13173 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bd6d24f73f9485684e0cb71f8dbf46c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:08:54 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:55224
I20260812 11:08:54.528795 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 13024
I20260812 11:08:54.537411 13825 tablet_replica.cc:330] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d: stopping tablet replica
I20260812 11:08:54.537858 13825 raft_consensus.cc:2229] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:08:54.538398 13825 raft_consensus.cc:2258] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:08:54.539368 13822 tablet_replica.cc:330] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2: stopping tablet replica
I20260812 11:08:54.539758 13822 raft_consensus.cc:2229] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:08:54.540196 13822 raft_consensus.cc:2258] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:08:54.541039 13825 ts_tablet_manager.cc:1905] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:08:54.541891 13822 ts_tablet_manager.cc:1905] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:08:54.544032 13825 ts_tablet_manager.cc:1918] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:08:54.544324 13825 log.cc:1196] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/5bd6d24f73f9485684e0cb71f8dbf46c
I20260812 11:08:54.544703 13822 ts_tablet_manager.cc:1918] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:08:54.544809 13822 log.cc:1196] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/5bd6d24f73f9485684e0cb71f8dbf46c
I20260812 11:08:54.544992 13825 ts_tablet_manager.cc:1939] T 5bd6d24f73f9485684e0cb71f8dbf46c P 3f24c8d8577f4706b0300e27a437126d: Deleting consensus metadata
I20260812 11:08:54.545156 13822 ts_tablet_manager.cc:1939] T 5bd6d24f73f9485684e0cb71f8dbf46c P 17a92247488e4614842d1be3090e17d2: Deleting consensus metadata
I20260812 11:08:54.546500 12938 catalog_manager.cc:4841] TS 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433): tablet 5bd6d24f73f9485684e0cb71f8dbf46c (table test-table [id=f8020e02247d4c55996bfc884ac38bb9]) successfully deleted
I20260812 11:08:54.546501 12937 catalog_manager.cc:4841] TS 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889): tablet 5bd6d24f73f9485684e0cb71f8dbf46c (table test-table [id=f8020e02247d4c55996bfc884ac38bb9]) successfully deleted
W20260812 11:08:54.547441 12938 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:33237 (error 108)
I20260812 11:08:54.548023 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 13303
I20260812 11:08:54.560593 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:54.560159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:33237 (local address 127.0.0.1:55232)
0812 11:08:54.560396 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:54.560491 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:33237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
W20260812 11:08:54.560801 12938 catalog_manager.cc:4584] TS 84eba57166ea4175adf9ae193e3bb951 (127.18.174.193:33237): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5bd6d24f73f9485684e0cb71f8dbf46c: Network error: Client connection negotiation failed: client connection to 127.18.174.193:33237: connect: Connection refused (error 111)
I20260812 11:08:54.567693 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 13536
I20260812 11:08:54.581060 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 12910
I20260812 11:08:54.603004 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45957
--webserver_interface=127.18.174.254
--webserver_port=43051
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:41839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:45957
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:08:54.721093 13828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:54.721374 13828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:54.721416 13828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:54.725592 13828 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:08:54.725659 13828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:54.725677 13828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:54.725694 13828 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:08:54.725725 13828 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:08:54.731292 13828 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:41839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:45957
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=43051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:54.732506 13828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:54.733594 13828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:54.742868 13838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:54.742913 13839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:54.742868 13842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:54.743052 13828 server_base.cc:1034] running on GCE node
I20260812 11:08:54.744213 13828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:54.745509 13828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:54.746698 13828 hybrid_clock.cc:648] HybridClock initialized: now 1786532934746676 us; error 40 us; skew 500 ppm
Aug 12 11:08:54 dist-test-slave-lgr5 krb5kdc[11999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532934, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:54.749892 13828 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:08:54.750893 13828 webserver.cc:460] Webserver started at http://127.18.174.254:43051/ using document root <none> and password file <none>
I20260812 11:08:54.751456 13828 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:54.751520 13828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:54.755746 13828 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:08:54.758389 13850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:54.759874 13828 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:08:54.760053 13828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "9fe816679c8442bb913a396c46ad863f"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "863ead4723a76190c743ceb1f2b1fab1"
server_key_iv: "5a58c524d066ef26a0fc9b4bc9a27e82"
server_key_version: "encryptionkey@0"
I20260812 11:08:54.760731 13828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:54.776683 13828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:54.780304 13828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:54.780520 13828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:54.788451 13828 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:45957
I20260812 11:08:54.788729 13933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:45957 every 8 connection(s)
I20260812 11:08:54.789767 13828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:08:54.790846 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 13828
I20260812 11:08:54.791348 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:33237
--local_ip_for_outbound_sockets=127.18.174.193
--tserver_master_addrs=127.18.174.254:45957
--webserver_port=37733
--webserver_interface=127.18.174.193
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:41839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:08:54.795619 13935 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:08:54.797734 13935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: Bootstrap starting.
I20260812 11:08:54.816787 13935 log.cc:824] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:54.829674 13935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:08:54.830096 13935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f: Bootstrap complete.
I20260812 11:08:54.834204 13935 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } }
I20260812 11:08:54.834630 13935 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe816679c8442bb913a396c46ad863f, State: Initialized, Role: FOLLOWER
I20260812 11:08:54.835150 13935 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } }
I20260812 11:08:54.835285 13935 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:08:54.835353 13935 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:08:54.835451 13935 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 2 FOLLOWER]: Advancing to term 3
I20260812 11:08:54.837589 13935 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } }
I20260812 11:08:54.837931 13935 leader_election.cc:302] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fe816679c8442bb913a396c46ad863f; no voters:
I20260812 11:08:54.838263 13935 leader_election.cc:288] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 11:08:54.838370 13945 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 3 FOLLOWER]: Leader election won for term 3
I20260812 11:08:54.838567 13945 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [term 3 LEADER]: Becoming Leader. State: Replica: 9fe816679c8442bb913a396c46ad863f, State: Running, Role: LEADER
I20260812 11:08:54.838896 13945 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } }
I20260812 11:08:54.839646 13935 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:08:54.839929 13945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fe816679c8442bb913a396c46ad863f. Latest consensus state: current_term: 3 leader_uuid: "9fe816679c8442bb913a396c46ad863f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } } }
I20260812 11:08:54.840050 13945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [sys.catalog]: This master's current role is: LEADER
I20260812 11:08:54.840490 13947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9fe816679c8442bb913a396c46ad863f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fe816679c8442bb913a396c46ad863f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45957 } } }
I20260812 11:08:54.840665 13947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fe816679c8442bb913a396c46ad863f [sys.catalog]: This master's current role is: LEADER
I20260812 11:08:54.841893 13950 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:08:54.847616 13950 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:08:54.848466 13950 catalog_manager.cc:1259] Loaded cluster ID: 79d119f157df47f488e38806e530a260
I20260812 11:08:54.848544 13950 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 11:08:54.849802 13950 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7ff0959af9ad google::LogMessage::Fail() at ??:0
@ 0x7ff0959b288a google::LogMessage::SendToLog() at ??:0
@ 0x7ff0959af4de google::LogMessage::Flush() at ??:0
@ 0x7ff0959b0a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ff0a02eefdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7ff0a02efd2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7ff0a02ec579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7ff0a0330640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7ff097c013d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ff097c01c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7ff097c033f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7ff097bf2512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff0992366db start_thread at ??:0
@ 0x7ff0944ad61f clone at ??:0
W20260812 11:08:54.940618 13937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:54.941068 13937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:54.941165 13937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:54.947242 13937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:54.947352 13937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:54.947460 13937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:08:54.955683 13937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:41839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:33237
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=37733
--tserver_master_addrs=127.18.174.254:45957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13937
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:54.957296 13937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:54.958814 13937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:54.971354 14008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:54.971549 14012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:54.971607 13937 server_base.cc:1034] running on GCE node
W20260812 11:08:54.971359 14006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:54.972546 13937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:54.973489 13937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:54.974714 13937 hybrid_clock.cc:648] HybridClock initialized: now 1786532934974688 us; error 38 us; skew 500 ppm
Aug 12 11:08:54 dist-test-slave-lgr5 krb5kdc[11999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532934, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:54.978583 13937 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:08:54.979903 13937 webserver.cc:460] Webserver started at http://127.18.174.193:37733/ using document root <none> and password file <none>
I20260812 11:08:54.980696 13937 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:54.980821 13937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:54.986743 13937 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:08:54.990015 14024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:54.991811 13937 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:08:54.991972 13937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "84eba57166ea4175adf9ae193e3bb951"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "27351dd656b987364197be08ea1245b8"
server_key_iv: "998659f6eaec86237535626ad7095c70"
server_key_version: "encryptionkey@0"
I20260812 11:08:54.992802 13937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:55.013391 13937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:55.018040 13937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:55.018297 13937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:55.019157 13937 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:08:55.020740 14035 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 11:08:55.025348 13937 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 11:08:55.025477 13937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260812 11:08:55.025574 13937 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 11:08:55.028059 13937 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 11:08:55.028167 13937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.003s
I20260812 11:08:55.028478 14035 tablet_bootstrap.cc:492] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951: Bootstrap starting.
I20260812 11:08:55.040505 13937 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:33237
I20260812 11:08:55.040838 14222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:33237 every 8 connection(s)
I20260812 11:08:55.041867 13937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:08:55.048156 14035 log.cc:824] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951: Log is configured to *not* fsync() on all Append() calls
I20260812 11:08:55.050525 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 13937
I20260812 11:08:55.050987 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:33433
--local_ip_for_outbound_sockets=127.18.174.194
--tserver_master_addrs=127.18.174.254:45957
--webserver_port=37801
--webserver_interface=127.18.174.194
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:41839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:08:55.055946 14035 tablet_bootstrap.cc:492] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:08:55.056380 14035 tablet_bootstrap.cc:492] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951: Bootstrap complete.
I20260812 11:08:55.057346 14035 ts_tablet_manager.cc:1397] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951: Time spent bootstrapping tablet: real 0.029s user 0.014s sys 0.013s
I20260812 11:08:55.059922 14035 raft_consensus.cc:348] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
I20260812 11:08:55.060401 14035 raft_consensus.cc:729] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84eba57166ea4175adf9ae193e3bb951, State: Initialized, Role: FOLLOWER
I20260812 11:08:55.060899 14035 consensus_queue.cc:260] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
I20260812 11:08:55.061846 14035 ts_tablet_manager.cc:1428] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951: Time spent starting tablet: real 0.004s user 0.003s sys 0.002s
W20260812 11:08:55.115660 14227 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:08:55.044457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:49569)
0812 11:08:55.045120 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:55.045184 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:55.046367 (+ 1183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:55.114826 (+ 68459us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":202,"threads_started":1}
W20260812 11:08:55.116405 14223 heartbeater.cc:644] Failed to heartbeat to 127.18.174.254:45957 (0 consecutive failures): Network error: Failed to ping master at 127.18.174.254:45957: Client connection negotiation failed: client connection to 127.18.174.254:45957: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 11:08:55.117223 14227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:55.116918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:43801)
0812 11:08:55.117060 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:55.117143 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 11:08:55.117899 14227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:55.117644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:46387)
0812 11:08:55.117762 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:55.117821 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 11:08:55.118078 14223 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:08:55.193399 14233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:55.193681 14233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:55.193725 14233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:55.197841 14233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:55.197913 14233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:55.197974 14233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:08:55.203527 14233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:41839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:33433
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=37801
--tserver_master_addrs=127.18.174.254:45957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:55.204741 14233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:55.205766 14233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:55.215755 14251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:55.215760 14256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:55.215750 14253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:55.215819 14233 server_base.cc:1034] running on GCE node
I20260812 11:08:55.216434 14233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:55.217150 14233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:55.218317 14233 hybrid_clock.cc:648] HybridClock initialized: now 1786532935218292 us; error 36 us; skew 500 ppm
Aug 12 11:08:55 dist-test-slave-lgr5 krb5kdc[11999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532935, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:55.221221 14233 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:08:55.222200 14233 webserver.cc:460] Webserver started at http://127.18.174.194:37801/ using document root <none> and password file <none>
I20260812 11:08:55.222781 14233 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:55.222852 14233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:55.227020 14233 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:08:55.229399 14268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:55.230821 14233 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:08:55.230978 14233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "3f24c8d8577f4706b0300e27a437126d"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "1893657d4c92aa8bde58420e56daf29c"
server_key_iv: "75cbac8bc273deef40929be058b87fa4"
server_key_version: "encryptionkey@0"
I20260812 11:08:55.231582 14233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:55.252218 14233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:55.255590 14233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:55.255789 14233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:55.256520 14233 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:08:55.257418 14233 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:08:55.257468 14233 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:55.257524 14233 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:08:55.257550 14233 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:55.266466 14233 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:33433
I20260812 11:08:55.266543 14463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:33433 every 8 connection(s)
I20260812 11:08:55.267547 14233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:08:55.271703 14468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:55.269843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:57623)
0812 11:08:55.270391 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:55.270863 (+ 472us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":120,"threads_started":1}
I20260812 11:08:55.272233 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 14233
W20260812 11:08:55.272277 14464 heartbeater.cc:644] Failed to heartbeat to 127.18.174.254:45957 (0 consecutive failures): Network error: Failed to ping master at 127.18.174.254:45957: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
I20260812 11:08:55.272730 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:32889
--local_ip_for_outbound_sockets=127.18.174.195
--tserver_master_addrs=127.18.174.254:45957
--webserver_port=33443
--webserver_interface=127.18.174.195
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:41839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:08:55.272959 14468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:55.272714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:33695)
0812 11:08:55.272842 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:55.272898 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 11:08:55.273658 14468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:55.273452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:33667)
0812 11:08:55.273562 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:55.273607 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 11:08:55.273828 14464 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:08:55.390635 14471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:08:55.390930 14471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:08:55.390976 14471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:08:55.395027 14471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:08:55.395090 14471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:08:55.395147 14471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:08:55.400517 14471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:41839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:32889
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=33443
--tserver_master_addrs=127.18.174.254:45957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:08:55.401599 14471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:08:55.402614 14471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:08:55.412801 14485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:08:55.412851 14484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:55.412846 14471 server_base.cc:1034] running on GCE node
W20260812 11:08:55.412958 14489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:08:55.413539 14471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:08:55.414242 14471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:08:55.415412 14471 hybrid_clock.cc:648] HybridClock initialized: now 1786532935415382 us; error 47 us; skew 500 ppm
Aug 12 11:08:55 dist-test-slave-lgr5 krb5kdc[11999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532935, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:08:55.418306 14471 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:08:55.419220 14471 webserver.cc:460] Webserver started at http://127.18.174.195:33443/ using document root <none> and password file <none>
I20260812 11:08:55.419801 14471 fs_manager.cc:359] Metadata directory not provided
I20260812 11:08:55.419871 14471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:08:55.423990 14471 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:08:55.426370 14499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:55.427736 14471 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:08:55.427866 14471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "17a92247488e4614842d1be3090e17d2"
format_stamp: "Formatted at 2026-08-12 11:08:52 on dist-test-slave-lgr5"
server_key: "1f0e44ad1fcc98b4218967979170f805"
server_key_iv: "76d200269e3e3b04a1a1d98cfbacb5d8"
server_key_version: "encryptionkey@0"
I20260812 11:08:55.428524 14471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:08:55.444283 14471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:08:55.447808 14471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:08:55.448014 14471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:08:55.448697 14471 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:08:55.449597 14471 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:08:55.449645 14471 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:55.449699 14471 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:08:55.449729 14471 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:08:55.458618 14471 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:32889
I20260812 11:08:55.458643 14700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:32889 every 8 connection(s)
I20260812 11:08:55.459643 14471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:08:55.460762 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 14471
I20260812 11:08:55.463878 14707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:55.462195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:48613)
0812 11:08:55.462662 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:55.463096 (+ 434us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":118,"threads_started":1}
W20260812 11:08:55.464363 14702 heartbeater.cc:644] Failed to heartbeat to 127.18.174.254:45957 (0 consecutive failures): Network error: Failed to ping master at 127.18.174.254:45957: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
I20260812 11:08:55.464987 14707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:55.464761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:51479)
0812 11:08:55.464877 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:55.464926 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 11:08:55.465644 14707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:55.465429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:37371)
0812 11:08:55.465544 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:55.465590 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 11:08:55.465826 14702 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 11:08:56.119274 14708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:56.118816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:56697)
0812 11:08:56.119099 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:56.119169 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":80,"threads_started":1}
I20260812 11:08:56.275044 14710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:56.274533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:42567)
0812 11:08:56.274828 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:56.274897 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":90,"threads_started":1}
I20260812 11:08:56.297386 14714 raft_consensus.cc:482] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:08:56.297616 14714 raft_consensus.cc:504] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
I20260812 11:08:56.298771 14714 leader_election.cc:288] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433), 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889)
Aug 12 11:08:56 dist-test-slave-lgr5 krb5kdc[11999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532934, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.194@KRBTEST.COM
Aug 12 11:08:56 dist-test-slave-lgr5 krb5kdc[11999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532934, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.195@KRBTEST.COM
I20260812 11:08:56.312875 14716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:56.299150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:55071 (local address 127.18.174.194:33433)
0812 11:08:56.299597 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:56.299632 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:56.299685 (+ 53us) server_negotiation.cc:407] Connection header received
0812 11:08:56.300523 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:56.300532 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:56.300885 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:56.301133 (+ 248us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:56.302603 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:56.303718 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:56.304998 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:56.305580 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:56.305749 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:56.308409 (+ 2660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:56.308415 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:56.308430 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:56.308463 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:56.310218 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:56.310844 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:56.310849 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:56.310853 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:56.310972 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:56.311298 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:56.311302 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:56.311304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:56.311717 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:56.311848 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:56.312421 (+ 573us) server_negotiation.cc:299] Negotiation successful
0812 11:08:56.312684 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":83,"threads_started":1}
I20260812 11:08:56.312896 14708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:56.299024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:33433 (local address 127.18.174.193:55071)
0812 11:08:56.299207 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:56.299224 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:56.299337 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:56.301261 (+ 1924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:56.301267 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:56.301813 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:56.302402 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:56.302422 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:56.303888 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:56.303891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:56.304872 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:56.304883 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:56.305705 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:56.305709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:56.305858 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:56.306507 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:56.306525 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:56.308163 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:56.310350 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:56.310357 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:56.310372 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:56.310725 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:56.311065 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:56.311068 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:56.311071 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:56.311207 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:56.311833 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:56.311839 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:56.312110 (+ 271us) client_negotiation.cc:769] Sending connection context
0812 11:08:56.312293 (+ 183us) client_negotiation.cc:240] Negotiation successful
0812 11:08:56.312758 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"mutex_wait_us":267,"spinlock_wait_cycles":53888}
I20260812 11:08:56.312974 14717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:56.299221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:36957 (local address 127.18.174.195:32889)
0812 11:08:56.299768 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0812 11:08:56.299780 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:08:56.299915 (+ 135us) server_negotiation.cc:407] Connection header received
0812 11:08:56.300689 (+ 774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:08:56.300696 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:08:56.301030 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:08:56.301332 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:08:56.302703 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:56.303735 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:56.304990 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:08:56.305557 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:08:56.305717 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:56.308665 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:08:56.308670 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:08:56.308682 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:08:56.308710 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:08:56.310248 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:56.310829 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:56.310835 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:56.310839 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:56.310955 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:08:56.311286 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:08:56.311290 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:08:56.311291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:08:56.311717 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:08:56.311840 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 11:08:56.312491 (+ 651us) server_negotiation.cc:299] Negotiation successful
0812 11:08:56.312780 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":246,"threads_started":1}
I20260812 11:08:56.313418 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:56.299031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:32889 (local address 127.18.174.193:36957)
0812 11:08:56.299801 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:56.299815 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:08:56.299932 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:08:56.301291 (+ 1359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:08:56.301294 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:08:56.301813 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:08:56.302404 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:56.302423 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:56.303884 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:56.303887 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:56.304868 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:08:56.304878 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:08:56.305680 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:08:56.305683 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:08:56.305860 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:08:56.306553 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:08:56.306565 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:08:56.308469 (+ 1904us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:08:56.310357 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:56.310360 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:56.310373 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:56.310719 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:56.311049 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:08:56.311052 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:08:56.311054 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:08:56.311200 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:08:56.311831 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:08:56.311837 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:08:56.312108 (+ 271us) client_negotiation.cc:769] Sending connection context
0812 11:08:56.312294 (+ 186us) client_negotiation.cc:240] Negotiation successful
0812 11:08:56.312653 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"mutex_wait_us":592,"spinlock_wait_cycles":27264,"thread_start_us":112,"threads_started":1}
W20260812 11:08:56.315604 14030 leader_election.cc:341] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433): Not found: Tablet not found: 5bd6d24f73f9485684e0cb71f8dbf46c
W20260812 11:08:56.316107 14029 leader_election.cc:341] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889): Not found: Tablet not found: 5bd6d24f73f9485684e0cb71f8dbf46c
I20260812 11:08:56.316198 14029 leader_election.cc:302] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84eba57166ea4175adf9ae193e3bb951; no voters: 17a92247488e4614842d1be3090e17d2, 3f24c8d8577f4706b0300e27a437126d
I20260812 11:08:56.316471 14714 raft_consensus.cc:2726] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:08:56.466912 14722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:56.466462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:46225)
0812 11:08:56.466744 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:56.466806 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":91,"threads_started":1}
I20260812 11:08:57.120785 14723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:57.120299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:53061)
0812 11:08:57.120603 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:57.120682 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":80,"threads_started":1}
I20260812 11:08:57.276376 14724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:57.275925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:34719)
0812 11:08:57.276218 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:57.276275 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":77,"threads_started":1}
I20260812 11:08:57.468171 14726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:57.467709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:41861)
0812 11:08:57.467950 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:57.468016 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":79,"threads_started":1}
I20260812 11:08:58.122157 14727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:58.121621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:54433)
0812 11:08:58.121940 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:58.122028 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":87,"threads_started":1}
I20260812 11:08:58.263988 14729 raft_consensus.cc:482] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:08:58.264184 14729 raft_consensus.cc:504] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
I20260812 11:08:58.264581 14729 leader_election.cc:288] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433), 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889)
W20260812 11:08:58.265430 14030 leader_election.cc:341] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433): Not found: Tablet not found: 5bd6d24f73f9485684e0cb71f8dbf46c
W20260812 11:08:58.265566 14029 leader_election.cc:341] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889): Not found: Tablet not found: 5bd6d24f73f9485684e0cb71f8dbf46c
I20260812 11:08:58.265656 14029 leader_election.cc:302] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84eba57166ea4175adf9ae193e3bb951; no voters: 17a92247488e4614842d1be3090e17d2, 3f24c8d8577f4706b0300e27a437126d
I20260812 11:08:58.265815 14729 raft_consensus.cc:2726] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:08:58.277592 14736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:58.277141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:59407)
0812 11:08:58.277407 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:58.277470 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":83,"threads_started":1}
I20260812 11:08:58.469458 14737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:58.469012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:55619)
0812 11:08:58.469288 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:58.469354 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":86,"threads_started":1}
I20260812 11:08:59.123572 14738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:59.123080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:59023)
0812 11:08:59.123386 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:59.123462 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":81,"threads_started":1}
I20260812 11:08:59.279080 14743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:59.278591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:45143)
0812 11:08:59.278901 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:59.278970 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":88,"threads_started":1}
I20260812 11:08:59.470721 14744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:08:59.470298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:40615)
0812 11:08:59.470558 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 11:08:59.470619 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":81,"threads_started":1}
I20260812 11:09:00.125104 14745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:00.124594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:47117)
0812 11:09:00.124941 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:00.125002 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":95,"threads_started":1}
I20260812 11:09:00.280611 14747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:00.280006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:43669)
0812 11:09:00.280419 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:00.280499 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":121,"threads_started":1}
I20260812 11:09:00.472144 14749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:00.471637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:37651)
0812 11:09:00.471927 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:00.471999 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":101,"threads_started":1}
I20260812 11:09:01.126415 14750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:01.125968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:37217)
0812 11:09:01.126248 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:01.126314 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":102,"threads_started":1}
I20260812 11:09:01.282104 14751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:01.281602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:57115)
0812 11:09:01.281928 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:01.281999 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":86,"threads_started":1}
I20260812 11:09:01.473436 14752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:01.472966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:34677)
0812 11:09:01.473244 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:01.473302 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":86,"threads_started":1}
I20260812 11:09:01.620453 14753 raft_consensus.cc:482] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:09:01.620596 14753 raft_consensus.cc:504] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
I20260812 11:09:01.621021 14753 leader_election.cc:288] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433), 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889)
W20260812 11:09:01.621899 14030 leader_election.cc:341] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433): Not found: Tablet not found: 5bd6d24f73f9485684e0cb71f8dbf46c
W20260812 11:09:01.622023 14029 leader_election.cc:341] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889): Not found: Tablet not found: 5bd6d24f73f9485684e0cb71f8dbf46c
I20260812 11:09:01.622088 14029 leader_election.cc:302] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84eba57166ea4175adf9ae193e3bb951; no voters: 17a92247488e4614842d1be3090e17d2, 3f24c8d8577f4706b0300e27a437126d
I20260812 11:09:01.622224 14753 raft_consensus.cc:2726] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:09:02.127735 14755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:02.127278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:36993)
0812 11:09:02.127562 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:02.127628 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":95,"threads_started":1}
I20260812 11:09:02.283465 14756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:02.282947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:43839)
0812 11:09:02.283287 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:02.283361 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":74,"threads_started":1}
I20260812 11:09:02.474908 14757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:02.474340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:58291)
0812 11:09:02.474719 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:02.474786 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":109,"threads_started":1}
I20260812 11:09:03.129104 14758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:03.128667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:49667)
0812 11:09:03.128924 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:03.129000 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":83,"threads_started":1}
I20260812 11:09:03.284876 14759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:03.284414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:33571)
0812 11:09:03.284697 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:03.284765 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":86,"threads_started":1}
I20260812 11:09:03.476406 14760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:03.475907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:32947)
0812 11:09:03.476223 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:03.476295 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":82,"threads_started":1}
I20260812 11:09:04.130481 14761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:04.130002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:59355)
0812 11:09:04.130277 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:04.130335 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":78,"threads_started":1}
I20260812 11:09:04.286098 14762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:04.285623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:58895)
0812 11:09:04.285931 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:04.285992 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":84,"threads_started":1}
I20260812 11:09:04.477747 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:04.477287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:57751)
0812 11:09:04.477569 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:04.477638 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":84,"threads_started":1}
I20260812 11:09:05.115094 14767 raft_consensus.cc:482] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:09:05.115239 14767 raft_consensus.cc:504] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
I20260812 11:09:05.115664 14767 leader_election.cc:288] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433), 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889)
W20260812 11:09:05.116493 14029 leader_election.cc:341] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889): Not found: Tablet not found: 5bd6d24f73f9485684e0cb71f8dbf46c
W20260812 11:09:05.116621 14030 leader_election.cc:341] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433): Not found: Tablet not found: 5bd6d24f73f9485684e0cb71f8dbf46c
I20260812 11:09:05.116696 14030 leader_election.cc:302] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84eba57166ea4175adf9ae193e3bb951; no voters: 17a92247488e4614842d1be3090e17d2, 3f24c8d8577f4706b0300e27a437126d
I20260812 11:09:05.116829 14767 raft_consensus.cc:2726] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:09:05.131953 14768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:05.131390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:43839)
0812 11:09:05.131767 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:05.131853 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":121,"threads_started":1}
I20260812 11:09:05.287634 14771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:05.287078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:49161)
0812 11:09:05.287444 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:05.287521 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":111,"threads_started":1}
I20260812 11:09:05.479271 14772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:05.478762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:47873)
0812 11:09:05.479089 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:05.479163 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":106,"threads_started":1}
I20260812 11:09:06.133395 14773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:06.132858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:50749)
0812 11:09:06.133182 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:06.133267 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":81,"threads_started":1}
I20260812 11:09:06.289116 14775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:06.288621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:43621)
0812 11:09:06.288925 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:06.289002 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":90,"threads_started":1}
I20260812 11:09:06.480702 14776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:06.480208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:42279)
0812 11:09:06.480523 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:06.480589 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":83,"threads_started":1}
I20260812 11:09:07.007874 14779 raft_consensus.cc:482] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:09:07.008036 14779 raft_consensus.cc:504] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f24c8d8577f4706b0300e27a437126d" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33433 } } peers { permanent_uuid: "17a92247488e4614842d1be3090e17d2" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 32889 } } peers { permanent_uuid: "84eba57166ea4175adf9ae193e3bb951" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 33237 } }
I20260812 11:09:07.008539 14779 leader_election.cc:288] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433), 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889)
W20260812 11:09:07.009384 14030 leader_election.cc:341] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3f24c8d8577f4706b0300e27a437126d (127.18.174.194:33433): Not found: Tablet not found: 5bd6d24f73f9485684e0cb71f8dbf46c
W20260812 11:09:07.009572 14029 leader_election.cc:341] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 17a92247488e4614842d1be3090e17d2 (127.18.174.195:32889): Not found: Tablet not found: 5bd6d24f73f9485684e0cb71f8dbf46c
I20260812 11:09:07.009686 14029 leader_election.cc:302] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84eba57166ea4175adf9ae193e3bb951; no voters: 17a92247488e4614842d1be3090e17d2, 3f24c8d8577f4706b0300e27a437126d
I20260812 11:09:07.009881 14779 raft_consensus.cc:2726] T 5bd6d24f73f9485684e0cb71f8dbf46c P 84eba57166ea4175adf9ae193e3bb951 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:09:07.134699 14781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:07.134251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:37379)
0812 11:09:07.134532 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:07.134598 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":83,"threads_started":1}
I20260812 11:09:07.290506 14783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:07.290020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:39349)
0812 11:09:07.290335 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:07.290404 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":80,"threads_started":1}
I20260812 11:09:07.482101 14785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:07.481637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:46865)
0812 11:09:07.481917 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:07.481995 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":90,"threads_started":1}
I20260812 11:09:08.136109 14786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:08.135520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:37217)
0812 11:09:08.135847 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:08.135916 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":79,"threads_started":1}
I20260812 11:09:08.291913 14787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:08.291442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:35451)
0812 11:09:08.291735 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:08.291806 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":90,"threads_started":1}
I20260812 11:09:08.483534 14788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:08.483017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:34409)
0812 11:09:08.483344 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:08.483416 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":84,"threads_started":1}
I20260812 11:09:09.137473 14790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:09.136980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:49919)
0812 11:09:09.137295 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:09.137370 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":86,"threads_started":1}
I20260812 11:09:09.293439 14794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:09.292929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:41069)
0812 11:09:09.293249 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:09.293317 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":112,"threads_started":1}
I20260812 11:09:09.484874 14795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:09.484379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:49003)
0812 11:09:09.484704 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:09.484768 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":130,"threads_started":1}
I20260812 11:09:10.138991 14796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:10.138460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.193:43665)
0812 11:09:10.138781 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:10.138862 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":93,"threads_started":1}
I20260812 11:09:10.294947 14800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:10.294450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.194:57751)
0812 11:09:10.294776 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:10.294843 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":80,"threads_started":1}
I20260812 11:09:10.467504 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 13937
I20260812 11:09:10.479110 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 14233
I20260812 11:09:10.489604 14805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:10.487403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:45957 (local address 127.18.174.195:36787)
0812 11:09:10.489410 (+ 2007us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:10.489479 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1924,"thread_start_us":1759,"threads_started":1}
I20260812 11:09:10.494925 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 14471
2026-08-12T11:09:10Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19831 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:09:10 dist-test-slave-lgr5 krb5kdc[14809](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:09:10 dist-test-slave-lgr5 krb5kdc[14809](info): set up 2 sockets
Aug 12 11:09:10 dist-test-slave-lgr5 krb5kdc[14809](info): commencing operation
krb5kdc: starting...
W20260812 11:09:11.715473 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:09:11 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532951, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:09:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:09:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:09:11.847579 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:40545
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:38191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:40545
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:09:11.963892 14834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:09:11.964241 14834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:09:11.964318 14834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:09:11.968423 14834 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 11:09:11.968498 14834 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 11:09:11.968519 14834 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 11:09:11.968536 14834 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:09:11.968562 14834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:09:11.968595 14834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:09:11.968626 14834 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:09:11.968653 14834 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:09:11.975355 14834 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:38191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:40545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:40545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:09:11.977013 14834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:09:11.978458 14834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:09:11.988428 14842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:11.988407 14847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:11.988498 14834 server_base.cc:1034] running on GCE node
W20260812 11:09:11.988456 14851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:11.989372 14834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:09:11.990681 14834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:09:11.991891 14834 hybrid_clock.cc:648] HybridClock initialized: now 1786532951991873 us; error 41 us; skew 500 ppm
Aug 12 11:09:11 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532951, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:09:11.995044 14834 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:09:11.996112 14834 webserver.cc:460] Webserver started at http://127.18.174.254:39629/ using document root <none> and password file <none>
I20260812 11:09:11.996721 14834 fs_manager.cc:359] Metadata directory not provided
I20260812 11:09:11.996795 14834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:09:11.997008 14834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:09:11.999199 14834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "a3b352009e114604bdca471ae5c3698c"
format_stamp: "Formatted at 2026-08-12 11:09:11 on dist-test-slave-lgr5"
server_key: "7ebc1ad42b386e2165fd39c81708be76"
server_key_iv: "5a4ad02a79b88704abb4e93f9fe093e9"
server_key_version: "encryptionkey@0"
I20260812 11:09:11.999805 14834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "a3b352009e114604bdca471ae5c3698c"
format_stamp: "Formatted at 2026-08-12 11:09:11 on dist-test-slave-lgr5"
server_key: "7ebc1ad42b386e2165fd39c81708be76"
server_key_iv: "5a4ad02a79b88704abb4e93f9fe093e9"
server_key_version: "encryptionkey@0"
I20260812 11:09:12.003901 14834 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260812 11:09:12.006625 14866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:12.007941 14834 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:09:12.008071 14834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "a3b352009e114604bdca471ae5c3698c"
format_stamp: "Formatted at 2026-08-12 11:09:11 on dist-test-slave-lgr5"
server_key: "7ebc1ad42b386e2165fd39c81708be76"
server_key_iv: "5a4ad02a79b88704abb4e93f9fe093e9"
server_key_version: "encryptionkey@0"
I20260812 11:09:12.008224 14834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:09:12.039637 14834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:09:12.042809 14834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:09:12.043007 14834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:09:12.050386 14834 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:40545
I20260812 11:09:12.050766 14956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:40545 every 8 connection(s)
I20260812 11:09:12.051460 14834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:09:12.054512 14958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:09:12.055368 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 14834
I20260812 11:09:12.055496 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:09:12.055783 19131 external_mini_cluster.cc:1428] Setting key 549630fe0112440b4fd713e23d22945c
I20260812 11:09:12.061379 14958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Bootstrap starting.
I20260812 11:09:12.064378 14958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Neither blocks nor log segments found. Creating new log.
Aug 12 11:09:12 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532951, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:09:12.065235 14958 log.cc:824] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:09:12.067701 14958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: No bootstrap required, opened a new log
I20260812 11:09:12.070564 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:12.057224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58016 (local address 127.18.174.254:40545)
0812 11:09:12.057657 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:12.057674 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:12.057712 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:09:12.058378 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:12.058396 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:12.058758 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:12.059055 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:09:12.059996 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.061051 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.062235 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.062731 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.062852 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:12.065847 (+ 2995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:09:12.065854 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:09:12.065874 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:09:12.065904 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:09:12.067645 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:12.068204 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:12.068210 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:12.068215 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:12.068338 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:12.068623 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:12.068625 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:12.068626 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:12.069045 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:09:12.069191 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:12.069485 (+ 294us) server_negotiation.cc:299] Negotiation successful
0812 11:09:12.069779 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":118,"threads_started":1}
I20260812 11:09:12.071884 14958 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } }
I20260812 11:09:12.072208 14958 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:09:12.072271 14958 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3b352009e114604bdca471ae5c3698c, State: Initialized, Role: FOLLOWER
I20260812 11:09:12.072751 14958 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } }
I20260812 11:09:12.072911 14958 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:09:12.072994 14958 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:09:12.073099 14958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:09:12.074060 14958 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } }
I20260812 11:09:12.074409 14958 leader_election.cc:302] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3b352009e114604bdca471ae5c3698c; no voters:
I20260812 11:09:12.074753 14958 leader_election.cc:288] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:09:12.074865 14966 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:09:12.075137 14966 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 1 LEADER]: Becoming Leader. State: Replica: a3b352009e114604bdca471ae5c3698c, State: Running, Role: LEADER
I20260812 11:09:12.075544 14966 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } }
I20260812 11:09:12.076025 14958 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:09:12.077353 14967 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3b352009e114604bdca471ae5c3698c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } } }
I20260812 11:09:12.077325 14968 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3b352009e114604bdca471ae5c3698c. Latest consensus state: current_term: 1 leader_uuid: "a3b352009e114604bdca471ae5c3698c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } } }
I20260812 11:09:12.077471 14967 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [sys.catalog]: This master's current role is: LEADER
I20260812 11:09:12.077488 14968 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [sys.catalog]: This master's current role is: LEADER
I20260812 11:09:12.077907 14980 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:09:12.080917 14980 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:09:12.086357 14980 catalog_manager.cc:1347] Generated new cluster ID: f24b774913464ba6b102b38d85b1ec4d
I20260812 11:09:12.086448 14980 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:09:12.110690 14980 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:09:12.111757 14980 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:09:12.120995 14980 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Generated new TSK 0
I20260812 11:09:12.121711 14980 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:09:12.155272 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:40545
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:38191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:09:12.275048 15003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:09:12.275394 15003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:09:12.275466 15003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:09:12.279770 15003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:09:12.279867 15003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:09:12.279964 15003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:09:12.285571 15003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:38191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:40545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:09:12.286738 15003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:09:12.287827 15003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:09:12.298090 15016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:12.298178 15015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:12.298156 15019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:12.298326 15003 server_base.cc:1034] running on GCE node
I20260812 11:09:12.298763 15003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:09:12.299649 15003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:09:12.300839 15003 hybrid_clock.cc:648] HybridClock initialized: now 1786532952300817 us; error 36 us; skew 500 ppm
Aug 12 11:09:12 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532952, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:09:12.303834 15003 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:09:12.304912 15003 webserver.cc:460] Webserver started at http://127.18.174.193:37405/ using document root <none> and password file <none>
I20260812 11:09:12.305519 15003 fs_manager.cc:359] Metadata directory not provided
I20260812 11:09:12.305594 15003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:09:12.305917 15003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:09:12.308218 15003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd"
format_stamp: "Formatted at 2026-08-12 11:09:12 on dist-test-slave-lgr5"
server_key: "c352eab23392207bac2b7bd452259f4a"
server_key_iv: "d013095d353658868dacd535d11500a7"
server_key_version: "encryptionkey@0"
I20260812 11:09:12.308810 15003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd"
format_stamp: "Formatted at 2026-08-12 11:09:12 on dist-test-slave-lgr5"
server_key: "c352eab23392207bac2b7bd452259f4a"
server_key_iv: "d013095d353658868dacd535d11500a7"
server_key_version: "encryptionkey@0"
I20260812 11:09:12.312775 15003 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:09:12.315286 15032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:12.316643 15003 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:09:12.316762 15003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd"
format_stamp: "Formatted at 2026-08-12 11:09:12 on dist-test-slave-lgr5"
server_key: "c352eab23392207bac2b7bd452259f4a"
server_key_iv: "d013095d353658868dacd535d11500a7"
server_key_version: "encryptionkey@0"
I20260812 11:09:12.316871 15003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:09:12.332176 15003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:09:12.335413 15003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:09:12.335638 15003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:09:12.336320 15003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:09:12.337253 15003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:09:12.337316 15003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:12.337373 15003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:09:12.337399 15003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:12.346189 15003 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:32847
I20260812 11:09:12.346218 15241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:32847 every 8 connection(s)
I20260812 11:09:12.347141 15003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:09:12.353119 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 15003
I20260812 11:09:12.353252 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:09:12.353557 19131 external_mini_cluster.cc:1428] Setting key e978c09819b80a51860151fe780fb560
Aug 12 11:09:12 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532952, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:09:12.362323 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:12.349258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:59099 (local address 127.18.174.254:40545)
0812 11:09:12.349420 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:12.349425 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:12.350350 (+ 925us) server_negotiation.cc:407] Connection header received
0812 11:09:12.351602 (+ 1252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:12.351605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:12.351655 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:12.351731 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:09:12.353032 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.353627 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.355038 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.355292 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.355383 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:12.358386 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:09:12.358391 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:09:12.358393 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:09:12.358423 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:09:12.359904 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:12.360634 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:12.360638 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:12.360640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:12.360765 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:12.361158 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:12.361160 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:12.361161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:12.361347 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:09:12.361420 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:12.362082 (+ 662us) server_negotiation.cc:299] Negotiation successful
0812 11:09:12.362197 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 11:09:12.363552 15245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:12.349695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:59099)
0812 11:09:12.350175 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:12.350221 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:12.351400 (+ 1179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:12.351907 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:12.351914 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:12.352339 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:09:12.352848 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:12.352863 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.353787 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.353791 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:12.354890 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:12.354903 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.355464 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.355469 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:12.355673 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:12.356322 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:09:12.356345 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:09:12.358192 (+ 1847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:09:12.360054 (+ 1862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:12.360061 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:12.360114 (+ 53us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:12.360499 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:12.360870 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:12.360873 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:12.360875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:12.361066 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:12.361450 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:09:12.361457 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:09:12.361815 (+ 358us) client_negotiation.cc:769] Sending connection context
0812 11:09:12.362051 (+ 236us) client_negotiation.cc:240] Negotiation successful
0812 11:09:12.362430 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":121,"threads_started":1}
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
I20260812 11:09:12.364909 15242 heartbeater.cc:347] Connected to a master server at 127.18.174.254:40545
I20260812 11:09:12.365156 15242 heartbeater.cc:464] Registering TS with master...
I20260812 11:09:12.365687 15242 heartbeater.cc:511] Master 127.18.174.254:40545 requested a full tablet report, sending...
I20260812 11:09:12.367332 14894 ts_manager.cc:194] Registered new tserver with Master: e6cdf076b5f84b5986b3e5acbbfe52dd (127.18.174.193:32847)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
I20260812 11:09:12.368924 14894 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:59099
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:09:12.384320 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:40545
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:38191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:09:12.501446 15249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:09:12.501731 15249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:09:12.501794 15249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:09:12.506011 15249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:09:12.506088 15249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:09:12.506174 15249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:09:12.511881 15249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:38191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:40545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:09:12.513160 15249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:09:12.514235 15249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:09:12.524376 15257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:12.524376 15263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:12.524456 15249 server_base.cc:1034] running on GCE node
W20260812 11:09:12.524380 15259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:12.525139 15249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:09:12.525794 15249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:09:12.526959 15249 hybrid_clock.cc:648] HybridClock initialized: now 1786532952526934 us; error 38 us; skew 500 ppm
Aug 12 11:09:12 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532952, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:09:12.533447 15249 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:09:12.534432 15249 webserver.cc:460] Webserver started at http://127.18.174.194:37815/ using document root <none> and password file <none>
I20260812 11:09:12.535058 15249 fs_manager.cc:359] Metadata directory not provided
I20260812 11:09:12.535132 15249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:09:12.535341 15249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:09:12.537683 15249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "ba784a02b8694cb7acf60b0e7c913935"
format_stamp: "Formatted at 2026-08-12 11:09:12 on dist-test-slave-lgr5"
server_key: "4e7561cb33290e13210f90de42d669c1"
server_key_iv: "39a18766634174b18fa8519a2dd2926e"
server_key_version: "encryptionkey@0"
I20260812 11:09:12.538271 15249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "ba784a02b8694cb7acf60b0e7c913935"
format_stamp: "Formatted at 2026-08-12 11:09:12 on dist-test-slave-lgr5"
server_key: "4e7561cb33290e13210f90de42d669c1"
server_key_iv: "39a18766634174b18fa8519a2dd2926e"
server_key_version: "encryptionkey@0"
I20260812 11:09:12.542436 15249 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:09:12.545054 15277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:12.546629 15249 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:09:12.546804 15249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "ba784a02b8694cb7acf60b0e7c913935"
format_stamp: "Formatted at 2026-08-12 11:09:12 on dist-test-slave-lgr5"
server_key: "4e7561cb33290e13210f90de42d669c1"
server_key_iv: "39a18766634174b18fa8519a2dd2926e"
server_key_version: "encryptionkey@0"
I20260812 11:09:12.546945 15249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:09:12.567502 15249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:09:12.570890 15249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:09:12.571065 15249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:09:12.571702 15249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:09:12.572666 15249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:09:12.572726 15249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:12.572770 15249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:09:12.572784 15249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:12.581660 15249 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:38043
I20260812 11:09:12.581704 15465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:38043 every 8 connection(s)
I20260812 11:09:12.582602 15249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:09:12.592068 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 15249
I20260812 11:09:12.592216 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
Aug 12 11:09:12 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532952, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:09:12.592537 19131 external_mini_cluster.cc:1428] Setting key 645f4be1190324390b25baf468fc43eb
I20260812 11:09:12.597261 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:12.584483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:57691 (local address 127.18.174.254:40545)
0812 11:09:12.584624 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:12.584628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:12.585529 (+ 901us) server_negotiation.cc:407] Connection header received
0812 11:09:12.586888 (+ 1359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:12.586891 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:12.586951 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:12.587024 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:09:12.588260 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.588788 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.589934 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.590156 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.590246 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:12.593090 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:09:12.593095 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:09:12.593098 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:09:12.593136 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:09:12.594759 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:12.595456 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:12.595458 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:12.595460 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:12.595536 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:12.595932 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:12.595934 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:12.595935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:12.596184 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:09:12.596264 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:12.596957 (+ 693us) server_negotiation.cc:299] Negotiation successful
0812 11:09:12.597099 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:09:12.598124 15468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:12.584920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:57691)
0812 11:09:12.585378 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:12.585422 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:12.586651 (+ 1229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:12.587210 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:12.587217 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:12.587582 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:09:12.588069 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:12.588115 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.588925 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.588928 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:12.589808 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:12.589817 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.590299 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.590303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:12.590477 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:12.591080 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:09:12.591097 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:09:12.592846 (+ 1749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:09:12.594905 (+ 2059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:12.594913 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:12.594931 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:12.595354 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:12.595620 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:12.595623 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:12.595625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:12.595836 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:12.596322 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:09:12.596330 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:09:12.596689 (+ 359us) client_negotiation.cc:769] Sending connection context
0812 11:09:12.596879 (+ 190us) client_negotiation.cc:240] Negotiation successful
0812 11:09:12.597179 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":108,"threads_started":1}
I20260812 11:09:12.599556 15466 heartbeater.cc:347] Connected to a master server at 127.18.174.254:40545
I20260812 11:09:12.599862 15466 heartbeater.cc:464] Registering TS with master...
I20260812 11:09:12.600589 15466 heartbeater.cc:511] Master 127.18.174.254:40545 requested a full tablet report, sending...
I20260812 11:09:12.601953 14894 ts_manager.cc:194] Registered new tserver with Master: ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194:38043)
I20260812 11:09:12.602789 14894 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:57691
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:09:12.623579 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:40545
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:38191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:09:12.738755 15476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:09:12.739041 15476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:09:12.739084 15476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:09:12.743364 15476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:09:12.743462 15476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:09:12.743527 15476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:09:12.749029 15476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:38191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:40545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:09:12.750172 15476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:09:12.751298 15476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:09:12.761417 15487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:12.761458 15476 server_base.cc:1034] running on GCE node
W20260812 11:09:12.761412 15483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:12.761420 15484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:12.762089 15476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:09:12.762737 15476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:09:12.763893 15476 hybrid_clock.cc:648] HybridClock initialized: now 1786532952763860 us; error 46 us; skew 500 ppm
Aug 12 11:09:12 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532952, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:09:12.766957 15476 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:09:12.767863 15476 webserver.cc:460] Webserver started at http://127.18.174.195:36829/ using document root <none> and password file <none>
I20260812 11:09:12.768464 15476 fs_manager.cc:359] Metadata directory not provided
I20260812 11:09:12.768533 15476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:09:12.768723 15476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:09:12.770900 15476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "a54ed96b250c4825bf13e3ba2429c7b1"
format_stamp: "Formatted at 2026-08-12 11:09:12 on dist-test-slave-lgr5"
server_key: "a2736cb2b87ff377511661260229a622"
server_key_iv: "7035539b7d06541ab7fa27551efe2b37"
server_key_version: "encryptionkey@0"
I20260812 11:09:12.771490 15476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "a54ed96b250c4825bf13e3ba2429c7b1"
format_stamp: "Formatted at 2026-08-12 11:09:12 on dist-test-slave-lgr5"
server_key: "a2736cb2b87ff377511661260229a622"
server_key_iv: "7035539b7d06541ab7fa27551efe2b37"
server_key_version: "encryptionkey@0"
I20260812 11:09:12.775804 15476 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:09:12.778699 15500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:12.780064 15476 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 11:09:12.780228 15476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "a54ed96b250c4825bf13e3ba2429c7b1"
format_stamp: "Formatted at 2026-08-12 11:09:12 on dist-test-slave-lgr5"
server_key: "a2736cb2b87ff377511661260229a622"
server_key_iv: "7035539b7d06541ab7fa27551efe2b37"
server_key_version: "encryptionkey@0"
I20260812 11:09:12.780347 15476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:09:12.801964 15476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:09:12.805243 15476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:09:12.805475 15476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:09:12.806137 15476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:09:12.807041 15476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:09:12.807090 15476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:12.807130 15476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:09:12.807158 15476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:12.816404 15476 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:45473
I20260812 11:09:12.816495 15702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:45473 every 8 connection(s)
I20260812 11:09:12.817703 15476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:09:12.821645 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 15476
I20260812 11:09:12.821784 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:09:12.822111 19131 external_mini_cluster.cc:1428] Setting key 885946989255d95d7b3c4b0c28038c08
Aug 12 11:09:12 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532952, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:09:12.833036 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:12.820071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:53477 (local address 127.18.174.254:40545)
0812 11:09:12.820253 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:12.820258 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:12.821549 (+ 1291us) server_negotiation.cc:407] Connection header received
0812 11:09:12.823515 (+ 1966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:12.823519 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:12.823582 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:12.823667 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:09:12.825189 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.825744 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.826848 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.827057 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.827128 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:12.829469 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:09:12.829473 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:09:12.829475 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:09:12.829501 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:09:12.830925 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:12.831467 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:12.831469 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:12.831471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:12.831543 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:12.831906 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:12.831909 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:12.831910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:12.832171 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:09:12.832264 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:12.832778 (+ 514us) server_negotiation.cc:299] Negotiation successful
0812 11:09:12.832906 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:09:12.833920 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:12.820538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:53477)
0812 11:09:12.821309 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:12.821415 (+ 106us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:12.823257 (+ 1842us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:12.823876 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:12.823887 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:12.824460 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:09:12.825054 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:12.825070 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.825844 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.825846 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:12.826739 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:12.826749 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.827177 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.827179 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:12.827323 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:12.827834 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:09:12.827850 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:09:12.829307 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:09:12.831053 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:12.831059 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:12.831072 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:12.831381 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:12.831612 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:12.831614 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:12.831615 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:12.831757 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:12.832281 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:09:12.832288 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:09:12.832549 (+ 261us) client_negotiation.cc:769] Sending connection context
0812 11:09:12.832709 (+ 160us) client_negotiation.cc:240] Negotiation successful
0812 11:09:12.832992 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":103,"threads_started":1}
I20260812 11:09:12.835249 15703 heartbeater.cc:347] Connected to a master server at 127.18.174.254:40545
I20260812 11:09:12.835523 15703 heartbeater.cc:464] Registering TS with master...
I20260812 11:09:12.836148 15703 heartbeater.cc:511] Master 127.18.174.254:40545 requested a full tablet report, sending...
I20260812 11:09:12.837275 14894 ts_manager.cc:194] Registered new tserver with Master: a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473)
I20260812 11:09:12.837831 14894 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:53477
I20260812 11:09:12.849130 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:09:12.858739 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:12.851193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58020 (local address 127.18.174.254:40545)
0812 11:09:12.851334 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:12.851339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:12.851545 (+ 206us) server_negotiation.cc:407] Connection header received
0812 11:09:12.851676 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:12.851679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:12.851727 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:12.851792 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:09:12.852617 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.853260 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.854196 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.854419 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.854509 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:12.855886 (+ 1377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:09:12.855889 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:09:12.855891 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:09:12.855917 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:09:12.857084 (+ 1167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:12.857505 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:12.857508 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:12.857509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:12.857590 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:12.857851 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:12.857855 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:12.857857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:12.858087 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:09:12.858222 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:12.858467 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 11:09:12.858583 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:09:12.861815 14894 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58020:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:09:12.865020 14894 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:09:12.880487 15733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:12.874594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59580 (local address 127.18.174.194:38043)
0812 11:09:12.875093 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:12.875108 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:12.875134 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:09:12.875212 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:12.875218 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:12.875442 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:12.875609 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:09:12.876138 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.877277 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.878911 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.879706 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.879821 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:12.879967 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:12.880212 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 11:09:12.880316 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":118,"threads_started":1}
I20260812 11:09:12.880548 15741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:12.875236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45473 (local address 127.0.0.1:53356)
0812 11:09:12.875951 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:12.875964 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:12.876062 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:12.876594 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:12.876597 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:12.876615 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:09:12.876716 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:12.876721 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.878122 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.878126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:12.879141 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:12.879149 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.880117 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.880120 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:12.880218 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:12.880242 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:09:12.880287 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 11:09:12.880417 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":117,"threads_started":1}
I20260812 11:09:12.880671 15739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:12.875429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53356 (local address 127.18.174.195:45473)
0812 11:09:12.876045 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:12.876057 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:12.876119 (+ 62us) server_negotiation.cc:407] Connection header received
0812 11:09:12.876202 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:12.876208 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:12.876451 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:12.876606 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:09:12.876824 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.877972 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.879248 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.879982 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.880135 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:12.880257 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:12.880333 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 11:09:12.880507 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":240,"threads_started":1}
I20260812 11:09:12.881048 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:12.874401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:38043 (local address 127.0.0.1:59580)
0812 11:09:12.874789 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:12.874842 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:12.874997 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:12.875770 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:12.875776 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:12.875801 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:09:12.875973 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:12.875981 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.877406 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.877409 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:12.878770 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:12.878782 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.879830 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.879833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:12.879943 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:12.879996 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 11:09:12.880838 (+ 842us) client_negotiation.cc:240] Negotiation successful
0812 11:09:12.880919 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":2,"thread_start_us":101,"threads_started":1}
I20260812 11:09:12.881379 15736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:12.875614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:32847 (local address 127.0.0.1:52510)
0812 11:09:12.876257 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:12.876269 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:12.876347 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:12.877010 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:12.877013 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:12.877032 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:09:12.877126 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:12.877132 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.878366 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.878370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:12.879348 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:12.879365 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.880741 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.880745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:12.881084 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:12.881111 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 11:09:12.881178 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:09:12.881258 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":101,"threads_started":1}
I20260812 11:09:12.882138 15742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:12.876055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52510 (local address 127.18.174.193:32847)
0812 11:09:12.876454 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:12.876460 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:12.876483 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:09:12.876558 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:12.876563 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:12.876741 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:12.876874 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:09:12.877255 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.878239 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.879494 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:12.880314 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:12.880534 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:12.880666 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:12.881910 (+ 1244us) server_negotiation.cc:299] Negotiation successful
0812 11:09:12.882009 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":100,"threads_started":1}
I20260812 11:09:12.884056 15575 tablet_service.cc:1467] Processing CreateTablet for tablet 8bc64c6b2b884399bf3d3a84b90e586a (DEFAULT_TABLE table=test-table [id=5021d7fe82f34ed5a3a5fe89b666aab3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:09:12.884101 15361 tablet_service.cc:1467] Processing CreateTablet for tablet 8bc64c6b2b884399bf3d3a84b90e586a (DEFAULT_TABLE table=test-table [id=5021d7fe82f34ed5a3a5fe89b666aab3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:09:12.885211 15361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bc64c6b2b884399bf3d3a84b90e586a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:09:12.885226 15575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bc64c6b2b884399bf3d3a84b90e586a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:09:12.884842 15120 tablet_service.cc:1467] Processing CreateTablet for tablet 8bc64c6b2b884399bf3d3a84b90e586a (DEFAULT_TABLE table=test-table [id=5021d7fe82f34ed5a3a5fe89b666aab3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:09:12.885779 15120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bc64c6b2b884399bf3d3a84b90e586a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:09:12.891290 15746 tablet_bootstrap.cc:492] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1: Bootstrap starting.
I20260812 11:09:12.892935 15748 tablet_bootstrap.cc:492] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935: Bootstrap starting.
I20260812 11:09:12.892935 15747 tablet_bootstrap.cc:492] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: Bootstrap starting.
I20260812 11:09:12.894076 15746 tablet_bootstrap.cc:654] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1: Neither blocks nor log segments found. Creating new log.
I20260812 11:09:12.894850 15746 log.cc:824] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1: Log is configured to *not* fsync() on all Append() calls
I20260812 11:09:12.895254 15747 tablet_bootstrap.cc:654] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: Neither blocks nor log segments found. Creating new log.
I20260812 11:09:12.895664 15748 tablet_bootstrap.cc:654] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935: Neither blocks nor log segments found. Creating new log.
I20260812 11:09:12.896306 15747 log.cc:824] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: Log is configured to *not* fsync() on all Append() calls
I20260812 11:09:12.896466 15748 log.cc:824] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935: Log is configured to *not* fsync() on all Append() calls
I20260812 11:09:12.897040 15746 tablet_bootstrap.cc:492] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1: No bootstrap required, opened a new log
I20260812 11:09:12.897264 15746 ts_tablet_manager.cc:1397] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:09:12.898224 15747 tablet_bootstrap.cc:492] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: No bootstrap required, opened a new log
I20260812 11:09:12.898412 15747 ts_tablet_manager.cc:1397] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:09:12.900802 15746 raft_consensus.cc:348] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:12.901137 15746 raft_consensus.cc:374] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:09:12.901232 15746 raft_consensus.cc:729] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54ed96b250c4825bf13e3ba2429c7b1, State: Initialized, Role: FOLLOWER
I20260812 11:09:12.901862 15748 tablet_bootstrap.cc:492] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935: No bootstrap required, opened a new log
I20260812 11:09:12.901782 15746 consensus_queue.cc:260] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:12.902086 15748 ts_tablet_manager.cc:1397] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260812 11:09:12.902549 15703 heartbeater.cc:503] Master 127.18.174.254:40545 was elected leader, sending a full tablet report...
I20260812 11:09:12.902424 15747 raft_consensus.cc:348] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:12.902690 15747 raft_consensus.cc:374] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:09:12.902735 15747 raft_consensus.cc:729] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6cdf076b5f84b5986b3e5acbbfe52dd, State: Initialized, Role: FOLLOWER
I20260812 11:09:12.902916 15746 ts_tablet_manager.cc:1428] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:09:12.903213 15747 consensus_queue.cc:260] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:12.903908 15242 heartbeater.cc:503] Master 127.18.174.254:40545 was elected leader, sending a full tablet report...
I20260812 11:09:12.904235 15747 ts_tablet_manager.cc:1428] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 11:09:12.906153 15748 raft_consensus.cc:348] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:12.906525 15748 raft_consensus.cc:374] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:09:12.906629 15748 raft_consensus.cc:729] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba784a02b8694cb7acf60b0e7c913935, State: Initialized, Role: FOLLOWER
I20260812 11:09:12.907130 15748 consensus_queue.cc:260] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:12.907841 15466 heartbeater.cc:503] Master 127.18.174.254:40545 was elected leader, sending a full tablet report...
I20260812 11:09:12.908231 15748 ts_tablet_manager.cc:1428] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:09:13.003844 15761 raft_consensus.cc:482] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:09:13.004145 15761 raft_consensus.cc:504] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:13.005529 15761 leader_election.cc:288] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473), e6cdf076b5f84b5986b3e5acbbfe52dd (127.18.174.193:32847)
I20260812 11:09:13.009424 15468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:13.005910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45473 (local address 127.18.174.194:39083)
0812 11:09:13.006050 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:13.006067 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:13.006176 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:13.006568 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:13.006570 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:13.006588 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:09:13.006687 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:13.006692 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:13.007459 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:13.007462 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:13.008304 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:13.008314 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:13.008988 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:13.008992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:13.009101 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:13.009120 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 11:09:13.009189 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 11:09:13.009272 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":23}
I20260812 11:09:13.009424 15739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:13.006027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:39083 (local address 127.18.174.195:45473)
0812 11:09:13.006194 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:13.006199 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:13.006242 (+ 43us) server_negotiation.cc:407] Connection header received
0812 11:09:13.006306 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:13.006309 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:13.006362 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:13.006435 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:09:13.006819 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:13.007327 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:13.008454 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:13.008869 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:13.008984 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:13.009045 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:13.009222 (+ 177us) server_negotiation.cc:299] Negotiation successful
0812 11:09:13.009301 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:09:13.009742 15762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:13.006206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:32847 (local address 127.18.174.194:59315)
0812 11:09:13.006617 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:13.006628 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:13.006727 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:13.006958 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:13.006961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:13.006976 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:09:13.007092 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:13.007097 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:13.007818 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:13.007822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:13.008664 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:13.008674 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:13.009326 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:13.009329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:13.009427 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:13.009448 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 11:09:13.009517 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 11:09:13.009593 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":1,"thread_start_us":181,"threads_started":1}
I20260812 11:09:13.009868 15742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:13.006367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:59315 (local address 127.18.174.193:32847)
0812 11:09:13.006521 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:13.006526 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:13.006713 (+ 187us) server_negotiation.cc:407] Connection header received
0812 11:09:13.006816 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:13.006819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:13.006863 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:13.006925 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:09:13.007206 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:13.007706 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:13.008792 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:13.009206 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:13.009319 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:13.009371 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:13.009675 (+ 304us) server_negotiation.cc:299] Negotiation successful
0812 11:09:13.009759 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:09:13.010286 15610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc64c6b2b884399bf3d3a84b90e586a" candidate_uuid: "ba784a02b8694cb7acf60b0e7c913935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" is_pre_election: true
I20260812 11:09:13.010463 15170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc64c6b2b884399bf3d3a84b90e586a" candidate_uuid: "ba784a02b8694cb7acf60b0e7c913935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" is_pre_election: true
I20260812 11:09:13.010694 15610 raft_consensus.cc:2454] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba784a02b8694cb7acf60b0e7c913935 in term 0.
I20260812 11:09:13.010715 15170 raft_consensus.cc:2454] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba784a02b8694cb7acf60b0e7c913935 in term 0.
I20260812 11:09:13.011226 15282 leader_election.cc:302] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba784a02b8694cb7acf60b0e7c913935, e6cdf076b5f84b5986b3e5acbbfe52dd; no voters:
I20260812 11:09:13.011531 15761 raft_consensus.cc:2781] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:09:13.011620 15761 raft_consensus.cc:482] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:09:13.011670 15761 raft_consensus.cc:3037] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:09:13.012863 15761 raft_consensus.cc:504] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:13.013219 15761 leader_election.cc:288] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [CANDIDATE]: Term 1 election: Requested vote from peers a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473), e6cdf076b5f84b5986b3e5acbbfe52dd (127.18.174.193:32847)
I20260812 11:09:13.013686 15610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc64c6b2b884399bf3d3a84b90e586a" candidate_uuid: "ba784a02b8694cb7acf60b0e7c913935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54ed96b250c4825bf13e3ba2429c7b1"
I20260812 11:09:13.013706 15170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc64c6b2b884399bf3d3a84b90e586a" candidate_uuid: "ba784a02b8694cb7acf60b0e7c913935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd"
I20260812 11:09:13.013831 15610 raft_consensus.cc:3037] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:09:13.013830 15170 raft_consensus.cc:3037] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:09:13.015213 15170 raft_consensus.cc:2454] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba784a02b8694cb7acf60b0e7c913935 in term 1.
I20260812 11:09:13.015213 15610 raft_consensus.cc:2454] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba784a02b8694cb7acf60b0e7c913935 in term 1.
I20260812 11:09:13.015554 15282 leader_election.cc:302] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba784a02b8694cb7acf60b0e7c913935, e6cdf076b5f84b5986b3e5acbbfe52dd; no voters:
I20260812 11:09:13.015736 15761 raft_consensus.cc:2781] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:09:13.015987 15761 raft_consensus.cc:686] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [term 1 LEADER]: Becoming Leader. State: Replica: ba784a02b8694cb7acf60b0e7c913935, State: Running, Role: LEADER
I20260812 11:09:13.016355 15761 consensus_queue.cc:237] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:13.019752 14894 catalog_manager.cc:5495] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194). New cstate: current_term: 1 leader_uuid: "ba784a02b8694cb7acf60b0e7c913935" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } health_report { overall_health: UNKNOWN } } }
I20260812 11:09:13.036343 15733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:13.032770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59592 (local address 127.18.174.194:38043)
0812 11:09:13.032917 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:13.032922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:13.032936 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:09:13.033016 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:13.033018 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:13.033074 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:13.033168 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:09:13.033440 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:13.033944 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:13.034782 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:13.034992 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:13.035098 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:13.035438 (+ 340us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:09:13.035889 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:09:13.036001 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:13.036071 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 11:09:13.036166 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:09:13.042508 15610 raft_consensus.cc:1261] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1 [term 1 FOLLOWER]: Refusing update from remote peer ba784a02b8694cb7acf60b0e7c913935: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:09:13.042508 15170 raft_consensus.cc:1261] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Refusing update from remote peer ba784a02b8694cb7acf60b0e7c913935: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:09:13.043284 15763 consensus_queue.cc:1035] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:09:13.043495 15761 consensus_queue.cc:1035] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:09:13.051771 15767 mvcc.cc:205] Tried to move back new op lower bound from 7317638975654633472 to 7317638975557918720. Current Snapshot: MvccSnapshot[applied={T|T < 7317638975654633472}]
I20260812 11:09:13.053038 15771 mvcc.cc:205] Tried to move back new op lower bound from 7317638975654633472 to 7317638975557918720. Current Snapshot: MvccSnapshot[applied={T|T < 7317638975654633472}]
I20260812 11:09:13.053223 15772 mvcc.cc:205] Tried to move back new op lower bound from 7317638975654633472 to 7317638975557918720. Current Snapshot: MvccSnapshot[applied={T|T < 7317638975654633472}]
I20260812 11:09:13.062093 14893 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:09:13.062264 14893 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:09:13.064663 14893 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Sending DeleteTablet for 3 replicas of tablet 8bc64c6b2b884399bf3d3a84b90e586a
I20260812 11:09:13.065490 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 15003
I20260812 11:09:13.068660 15361 tablet_service.cc:1514] Processing DeleteTablet for tablet 8bc64c6b2b884399bf3d3a84b90e586a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:09:13 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:59580
I20260812 11:09:13.072540 15575 tablet_service.cc:1514] Processing DeleteTablet for tablet 8bc64c6b2b884399bf3d3a84b90e586a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:09:13 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:53356
I20260812 11:09:13.073103 15793 tablet_replica.cc:330] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1: stopping tablet replica
I20260812 11:09:13.073553 15793 raft_consensus.cc:2229] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:09:13.074018 15793 raft_consensus.cc:2258] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:09:13.076313 15793 ts_tablet_manager.cc:1905] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:09:13.080019 15793 ts_tablet_manager.cc:1918] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:09:13.080197 15793 log.cc:1196] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/8bc64c6b2b884399bf3d3a84b90e586a
I20260812 11:09:13.080587 15793 ts_tablet_manager.cc:1939] T 8bc64c6b2b884399bf3d3a84b90e586a P a54ed96b250c4825bf13e3ba2429c7b1: Deleting consensus metadata
I20260812 11:09:13.082365 14870 catalog_manager.cc:4841] TS a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473): tablet 8bc64c6b2b884399bf3d3a84b90e586a (table test-table [id=5021d7fe82f34ed5a3a5fe89b666aab3]) successfully deleted
I20260812 11:09:13.092548 15791 tablet_replica.cc:330] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935: stopping tablet replica
I20260812 11:09:13.092996 15791 raft_consensus.cc:2229] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:09:13.093519 15791 raft_consensus.cc:2258] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:09:13.095368 15791 ts_tablet_manager.cc:1905] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 11:09:13.097893 14870 connection.cc:535] client connection to 127.18.174.193:32847 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 11:09:13.098071 14870 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 11:09:13.098243 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 15249
I20260812 11:09:13.117132 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:13.116765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:32847 (local address 127.0.0.1:52514)
0812 11:09:13.116968 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:13.117040 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:32847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260812 11:09:13.117478 14870 catalog_manager.cc:4584] TS e6cdf076b5f84b5986b3e5acbbfe52dd (127.18.174.193:32847): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8bc64c6b2b884399bf3d3a84b90e586a: Network error: Client connection negotiation failed: client connection to 127.18.174.193:32847: connect: Connection refused (error 111)
I20260812 11:09:13.126339 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 15476
I20260812 11:09:13.126899 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:13.126562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:38043 (local address 127.0.0.1:59604)
0812 11:09:13.126749 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:13.126807 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.194:38043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260812 11:09:13.148051 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 14834
I20260812 11:09:33.171197 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:40545
--webserver_interface=127.18.174.254
--webserver_port=39629
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:38191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:40545
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:09:33.288684 15797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:09:33.288978 15797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:09:33.289018 15797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:09:33.293020 15797 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 11:09:33.293080 15797 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 11:09:33.293095 15797 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 11:09:33.293107 15797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:09:33.293124 15797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:09:33.293140 15797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:09:33.293154 15797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:09:33.293169 15797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:09:33.298604 15797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:38191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:40545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:40545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=39629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:09:33.299685 15797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:09:33.300737 15797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:09:33.314613 15821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:33.314646 15812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:33.314689 15815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:33.314855 15797 server_base.cc:1034] running on GCE node
I20260812 11:09:33.315519 15797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:09:33.316844 15797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:09:33.318049 15797 hybrid_clock.cc:648] HybridClock initialized: now 1786532973318023 us; error 41 us; skew 500 ppm
Aug 12 11:09:33 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532973, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:09:33.324678 15797 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:09:33.325731 15797 webserver.cc:460] Webserver started at http://127.18.174.254:39629/ using document root <none> and password file <none>
I20260812 11:09:33.326370 15797 fs_manager.cc:359] Metadata directory not provided
I20260812 11:09:33.326459 15797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:09:33.330760 15797 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:09:33.333072 15829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:33.334458 15797 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:09:33.334599 15797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "a3b352009e114604bdca471ae5c3698c"
format_stamp: "Formatted at 2026-08-12 11:09:11 on dist-test-slave-lgr5"
server_key: "7ebc1ad42b386e2165fd39c81708be76"
server_key_iv: "5a4ad02a79b88704abb4e93f9fe093e9"
server_key_version: "encryptionkey@0"
I20260812 11:09:33.335240 15797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:09:33.349172 15797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:09:33.352532 15797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:09:33.352727 15797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:09:33.360190 15797 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:40545
I20260812 11:09:33.360483 15931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:40545 every 8 connection(s)
I20260812 11:09:33.361385 15797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:09:33.366142 15933 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:09:33.368037 15933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Bootstrap starting.
I20260812 11:09:33.369153 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 15797
I20260812 11:09:33.369633 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:32847
--local_ip_for_outbound_sockets=127.18.174.193
--tserver_master_addrs=127.18.174.254:40545
--webserver_port=37405
--webserver_interface=127.18.174.193
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:38191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:09:33.386042 15933 log.cc:824] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:09:33.395207 15933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:09:33.395617 15933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Bootstrap complete.
I20260812 11:09:33.399705 15933 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } }
I20260812 11:09:33.400158 15933 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3b352009e114604bdca471ae5c3698c, State: Initialized, Role: FOLLOWER
I20260812 11:09:33.400686 15933 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } }
I20260812 11:09:33.400817 15933 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:09:33.400895 15933 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:09:33.400991 15933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:09:33.402969 15933 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } }
I20260812 11:09:33.403321 15933 leader_election.cc:302] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3b352009e114604bdca471ae5c3698c; no voters:
I20260812 11:09:33.403646 15933 leader_election.cc:288] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:09:33.403784 15943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:09:33.403970 15943 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 2 LEADER]: Becoming Leader. State: Replica: a3b352009e114604bdca471ae5c3698c, State: Running, Role: LEADER
I20260812 11:09:33.404371 15943 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } }
I20260812 11:09:33.405011 15933 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:09:33.405943 15945 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3b352009e114604bdca471ae5c3698c. Latest consensus state: current_term: 2 leader_uuid: "a3b352009e114604bdca471ae5c3698c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } } }
I20260812 11:09:33.405987 15944 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a3b352009e114604bdca471ae5c3698c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } } }
I20260812 11:09:33.406075 15945 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [sys.catalog]: This master's current role is: LEADER
I20260812 11:09:33.406097 15944 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [sys.catalog]: This master's current role is: LEADER
I20260812 11:09:33.406425 15961 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:09:33.411479 15961 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:09:33.412308 15961 catalog_manager.cc:1259] Loaded cluster ID: f24b774913464ba6b102b38d85b1ec4d
I20260812 11:09:33.412421 15961 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:09:33.415067 15961 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:09:33.415828 15961 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Loaded TSK: 0
I20260812 11:09:33.432117 15961 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Generated new TSK 1
I20260812 11:09:33.432449 15961 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:09:33.490170 15938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:09:33.490439 15938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:09:33.490481 15938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:09:33.494526 15938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:09:33.494589 15938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:09:33.494649 15938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:09:33.500005 15938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:38191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:32847
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=37405
--tserver_master_addrs=127.18.174.254:40545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15938
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:09:33.501130 15938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:09:33.502151 15938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:09:33.511965 15982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:33.512014 15990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:33.511966 15984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:33.512264 15938 server_base.cc:1034] running on GCE node
I20260812 11:09:33.512702 15938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:09:33.513372 15938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:09:33.514549 15938 hybrid_clock.cc:648] HybridClock initialized: now 1786532973514528 us; error 33 us; skew 500 ppm
Aug 12 11:09:33 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532973, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:09:33.517416 15938 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:09:33.518345 15938 webserver.cc:460] Webserver started at http://127.18.174.193:37405/ using document root <none> and password file <none>
I20260812 11:09:33.518884 15938 fs_manager.cc:359] Metadata directory not provided
I20260812 11:09:33.518985 15938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:09:33.522951 15938 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:09:33.525199 15997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:33.526453 15938 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:09:33.526569 15938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd"
format_stamp: "Formatted at 2026-08-12 11:09:12 on dist-test-slave-lgr5"
server_key: "c352eab23392207bac2b7bd452259f4a"
server_key_iv: "d013095d353658868dacd535d11500a7"
server_key_version: "encryptionkey@0"
I20260812 11:09:33.527107 15938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:09:33.538713 15938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:09:33.541796 15938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:09:33.541980 15938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:09:33.542588 15938 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:09:33.543727 16009 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 11:09:33.548063 15938 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 11:09:33.548156 15938 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260812 11:09:33.548216 15938 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 11:09:33.549940 15938 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 11:09:33.549999 15938 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260812 11:09:33.550329 16009 tablet_bootstrap.cc:492] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: Bootstrap starting.
I20260812 11:09:33.560442 15938 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:32847
I20260812 11:09:33.560469 16209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:32847 every 8 connection(s)
I20260812 11:09:33.561681 15938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:09:33.567160 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 15938
I20260812 11:09:33.567735 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:38043
--local_ip_for_outbound_sockets=127.18.174.194
--tserver_master_addrs=127.18.174.254:40545
--webserver_port=37815
--webserver_interface=127.18.174.194
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:38191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:09:33.571255 16009 log.cc:824] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:09:33 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532973, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:09:33.580031 16009 tablet_bootstrap.cc:492] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:09:33.580139 16215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:33.563863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:56553 (local address 127.18.174.254:40545)
0812 11:09:33.564244 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:33.564266 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:33.564634 (+ 368us) server_negotiation.cc:407] Connection header received
0812 11:09:33.565744 (+ 1110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:33.565756 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:33.566060 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:33.566378 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:09:33.567588 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.568724 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.570140 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.570873 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.571064 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:33.574065 (+ 3001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:09:33.574073 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:09:33.574092 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:09:33.574129 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:09:33.576284 (+ 2155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:33.576979 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:33.576986 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:33.576992 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:33.577150 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:33.577567 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:33.577570 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:33.577572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:33.578062 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:09:33.578199 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:33.578909 (+ 710us) server_negotiation.cc:299] Negotiation successful
0812 11:09:33.579219 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":108,"threads_started":1}
I20260812 11:09:33.580176 16217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:33.563919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:56553)
0812 11:09:33.564466 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:33.564509 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:33.565326 (+ 817us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:33.566447 (+ 1121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:33.566455 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:33.566909 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:09:33.567421 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:33.567438 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.568885 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.568888 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:33.569986 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:33.570001 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.571054 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.571058 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:33.571224 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:33.571898 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:09:33.571920 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:09:33.573814 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:09:33.576463 (+ 2649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:33.576470 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:33.576486 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:33.576847 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:33.577257 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:33.577260 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:33.577263 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:33.577459 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:33.578189 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:09:33.578197 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:09:33.578544 (+ 347us) client_negotiation.cc:769] Sending connection context
0812 11:09:33.578766 (+ 222us) client_negotiation.cc:240] Negotiation successful
0812 11:09:33.579138 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":160,"threads_started":1}
I20260812 11:09:33.580533 16009 tablet_bootstrap.cc:492] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: Bootstrap complete.
I20260812 11:09:33.581735 16009 ts_tablet_manager.cc:1397] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: Time spent bootstrapping tablet: real 0.032s user 0.025s sys 0.004s
I20260812 11:09:33.582875 16210 heartbeater.cc:347] Connected to a master server at 127.18.174.254:40545
I20260812 11:09:33.583122 16210 heartbeater.cc:464] Registering TS with master...
I20260812 11:09:33.583696 16210 heartbeater.cc:511] Master 127.18.174.254:40545 requested a full tablet report, sending...
I20260812 11:09:33.584530 16009 raft_consensus.cc:348] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:33.585055 16009 raft_consensus.cc:729] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6cdf076b5f84b5986b3e5acbbfe52dd, State: Initialized, Role: FOLLOWER
I20260812 11:09:33.585567 16009 consensus_queue.cc:260] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:33.586515 16009 ts_tablet_manager.cc:1428] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 11:09:33.586652 15857 ts_manager.cc:194] Registered new tserver with Master: e6cdf076b5f84b5986b3e5acbbfe52dd (127.18.174.193:32847)
I20260812 11:09:33.591157 15857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:56553
I20260812 11:09:33.593961 16210 heartbeater.cc:503] Master 127.18.174.254:40545 was elected leader, sending a full tablet report...
Aug 12 11:09:33 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532973, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for kudu/127.18.174.193@KRBTEST.COM
I20260812 11:09:33.601212 16226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:33.590141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49942 (local address 127.18.174.193:32847)
0812 11:09:33.590843 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:33.590857 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:33.590894 (+ 37us) server_negotiation.cc:407] Connection header received
0812 11:09:33.590952 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:33.590956 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:33.591111 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:33.591230 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:09:33.592032 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.593080 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.594476 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.594859 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.594961 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:33.597468 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:09:33.597478 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:09:33.597488 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:09:33.597513 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:09:33.599125 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:33.599639 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:33.599645 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:33.599646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:33.599741 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:33.600029 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:33.600033 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:33.600035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:33.600373 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:09:33.600510 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:33.600886 (+ 376us) server_negotiation.cc:299] Negotiation successful
0812 11:09:33.601054 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":114,"threads_started":1}
I20260812 11:09:33.601212 16224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:33.590073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:32847 (local address 127.0.0.1:49942)
0812 11:09:33.590489 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:33.590536 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:33.590665 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:33.591263 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:33.591269 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:33.591680 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:09:33.591789 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:33.591796 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.593212 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.593216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:33.594176 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:33.594189 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.594977 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.594981 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:33.595111 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:33.595663 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:09:33.595678 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:09:33.597303 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:09:33.599246 (+ 1943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:33.599258 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:33.599264 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:33.599517 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:33.599840 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:33.599843 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:33.599846 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:33.599938 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:33.600497 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:09:33.600503 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:09:33.600638 (+ 135us) client_negotiation.cc:769] Sending connection context
0812 11:09:33.600783 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 11:09:33.601007 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":94,"threads_started":1}
I20260812 11:09:33.602617 16078 tablet_service.cc:1514] Processing DeleteTablet for tablet 8bc64c6b2b884399bf3d3a84b90e586a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:09:13 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:49942
I20260812 11:09:33.603504 16227 tablet_replica.cc:330] stopping tablet replica
I20260812 11:09:33.603835 16227 raft_consensus.cc:2229] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:09:33.604140 16227 raft_consensus.cc:2258] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:09:33.605280 16227 ts_tablet_manager.cc:1905] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:09:33.609931 16227 ts_tablet_manager.cc:1918] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:09:33.610056 16227 log.cc:1196] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal/wals/8bc64c6b2b884399bf3d3a84b90e586a
I20260812 11:09:33.610335 16227 ts_tablet_manager.cc:1939] T 8bc64c6b2b884399bf3d3a84b90e586a P e6cdf076b5f84b5986b3e5acbbfe52dd: Deleting consensus metadata
I20260812 11:09:33.612625 15832 catalog_manager.cc:4841] TS e6cdf076b5f84b5986b3e5acbbfe52dd (127.18.174.193:32847): tablet 8bc64c6b2b884399bf3d3a84b90e586a (table test-table [id=5021d7fe82f34ed5a3a5fe89b666aab3]) successfully deleted
W20260812 11:09:33.693394 16219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:09:33.693687 16219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:09:33.693747 16219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:09:33.697772 16219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:09:33.697842 16219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:09:33.697922 16219 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:09:33.703246 16219 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:38191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:38043
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=37815
--tserver_master_addrs=127.18.174.254:40545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:09:33.704372 16219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:09:33.705451 16219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:09:33.715605 16232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:33.715595 16233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:33.715756 16219 server_base.cc:1034] running on GCE node
W20260812 11:09:33.715593 16235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:33.716207 16219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:09:33.716902 16219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:09:33.718070 16219 hybrid_clock.cc:648] HybridClock initialized: now 1786532973718040 us; error 43 us; skew 500 ppm
Aug 12 11:09:33 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532973, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:09:33.720875 16219 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:09:33.721779 16219 webserver.cc:460] Webserver started at http://127.18.174.194:37815/ using document root <none> and password file <none>
I20260812 11:09:33.722326 16219 fs_manager.cc:359] Metadata directory not provided
I20260812 11:09:33.722400 16219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:09:33.726411 16219 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260812 11:09:33.728732 16249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:33.730094 16219 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:09:33.730204 16219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "ba784a02b8694cb7acf60b0e7c913935"
format_stamp: "Formatted at 2026-08-12 11:09:12 on dist-test-slave-lgr5"
server_key: "4e7561cb33290e13210f90de42d669c1"
server_key_iv: "39a18766634174b18fa8519a2dd2926e"
server_key_version: "encryptionkey@0"
I20260812 11:09:33.730755 16219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:09:33.757380 16219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:09:33.760579 16219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:09:33.760742 16219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:09:33.761339 16219 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:09:33.762429 16266 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260812 11:09:33.766340 16266 ts_tablet_manager.cc:1852] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260812 11:09:33.766742 16266 ts_tablet_manager.cc:1905] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:09:33.770961 16266 ts_tablet_manager.cc:1918] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:09:33.771096 16266 log.cc:1196] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/8bc64c6b2b884399bf3d3a84b90e586a
I20260812 11:09:33.771517 16266 ts_tablet_manager.cc:1939] T 8bc64c6b2b884399bf3d3a84b90e586a P ba784a02b8694cb7acf60b0e7c913935: Deleting consensus metadata
I20260812 11:09:33.771847 16219 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260812 11:09:33.771914 16219 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.010s user 0.000s sys 0.000s
I20260812 11:09:33.771974 16219 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:09:33.771994 16219 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:33.781219 16219 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:38043
I20260812 11:09:33.781309 16458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:38043 every 8 connection(s)
I20260812 11:09:33.782276 16219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:09:33.787043 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 16219
I20260812 11:09:33.787487 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:45473
--local_ip_for_outbound_sockets=127.18.174.195
--tserver_master_addrs=127.18.174.254:40545
--webserver_port=36829
--webserver_interface=127.18.174.195
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:38191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:09:33 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532973, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:09:33.796398 16215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:33.784332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:48717 (local address 127.18.174.254:40545)
0812 11:09:33.784518 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:33.784523 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:33.785503 (+ 980us) server_negotiation.cc:407] Connection header received
0812 11:09:33.786446 (+ 943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:33.786450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:33.786506 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:33.786590 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:09:33.787925 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.788729 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.789946 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.790186 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.790282 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:33.792986 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:09:33.792990 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:09:33.792993 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:09:33.793021 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:09:33.794331 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:33.794827 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:33.794831 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:33.794832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:33.794911 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:33.795250 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:33.795254 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:33.795256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:33.795446 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:09:33.795536 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:33.796053 (+ 517us) server_negotiation.cc:299] Negotiation successful
0812 11:09:33.796224 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:09:33.797245 16462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:33.784807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:48717)
0812 11:09:33.785320 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:33.785370 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:33.786217 (+ 847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:33.786745 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:33.786752 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:33.787141 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:09:33.787759 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:33.787776 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.788898 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.788901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:33.789795 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:33.789806 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.790339 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.790343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:33.790545 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:33.791130 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:09:33.791147 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:09:33.792800 (+ 1653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:09:33.794452 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:33.794458 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:33.794475 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:33.794732 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:33.795011 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:33.795015 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:33.795017 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:33.795160 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:33.795549 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:09:33.795555 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:09:33.795816 (+ 261us) client_negotiation.cc:769] Sending connection context
0812 11:09:33.795992 (+ 176us) client_negotiation.cc:240] Negotiation successful
0812 11:09:33.796363 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":140,"threads_started":1}
I20260812 11:09:33.798575 16459 heartbeater.cc:347] Connected to a master server at 127.18.174.254:40545
I20260812 11:09:33.798834 16459 heartbeater.cc:464] Registering TS with master...
I20260812 11:09:33.799340 16459 heartbeater.cc:511] Master 127.18.174.254:40545 requested a full tablet report, sending...
I20260812 11:09:33.800489 15857 ts_manager.cc:194] Registered new tserver with Master: ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194:38043)
I20260812 11:09:33.801288 15857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:48717
W20260812 11:09:33.905006 16463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:09:33.905328 16463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:09:33.905373 16463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:09:33.909591 16463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:09:33.909660 16463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:09:33.909720 16463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:09:33.915282 16463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:38191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:45473
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=36829
--tserver_master_addrs=127.18.174.254:40545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:09:33.916437 16463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:09:33.917469 16463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:09:33.927327 16463 server_base.cc:1034] running on GCE node
W20260812 11:09:33.927350 16470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:33.927376 16474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:33.927310 16471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:33.927961 16463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:09:33.928651 16463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:09:33.929828 16463 hybrid_clock.cc:648] HybridClock initialized: now 1786532973929806 us; error 31 us; skew 500 ppm
Aug 12 11:09:33 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532973, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:09:33.932701 16463 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:09:33.933600 16463 webserver.cc:460] Webserver started at http://127.18.174.195:36829/ using document root <none> and password file <none>
I20260812 11:09:33.934171 16463 fs_manager.cc:359] Metadata directory not provided
I20260812 11:09:33.934304 16463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:09:33.938488 16463 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:09:33.940796 16484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:33.942099 16463 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:09:33.942220 16463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "a54ed96b250c4825bf13e3ba2429c7b1"
format_stamp: "Formatted at 2026-08-12 11:09:12 on dist-test-slave-lgr5"
server_key: "a2736cb2b87ff377511661260229a622"
server_key_iv: "7035539b7d06541ab7fa27551efe2b37"
server_key_version: "encryptionkey@0"
I20260812 11:09:33.942771 16463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:09:33.959107 16463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:09:33.962489 16463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:09:33.962682 16463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:09:33.963331 16463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:09:33.964285 16463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:09:33.964334 16463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:33.964401 16463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:09:33.964426 16463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:33.973801 16463 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:45473
I20260812 11:09:33.973841 16693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:45473 every 8 connection(s)
I20260812 11:09:33.974929 16463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:09:33.975189 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 16463
I20260812 11:09:33.986312 16215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:33.976329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58456 (local address 127.18.174.254:40545)
0812 11:09:33.976667 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:33.976672 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:33.976714 (+ 42us) server_negotiation.cc:407] Connection header received
0812 11:09:33.976784 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:33.976788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:33.976842 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:33.976952 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:09:33.978310 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.979054 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.980272 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.980602 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.980693 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:33.982837 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:09:33.982840 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:09:33.982843 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:09:33.982869 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:09:33.984546 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:33.985035 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:33.985038 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:33.985039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:33.985128 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:33.985423 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:33.985426 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:33.985428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:33.985653 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:09:33.985884 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:33.986012 (+ 128us) server_negotiation.cc:299] Negotiation successful
0812 11:09:33.986145 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207}
Aug 12 11:09:33 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532973, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:09:33.992038 16698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:33.977550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:58371 (local address 127.18.174.254:40545)
0812 11:09:33.980248 (+ 2698us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:33.980253 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:33.980265 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:09:33.980695 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:33.980699 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:33.980762 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:33.980848 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:09:33.982433 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.983114 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.984891 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.985185 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.985297 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:33.988617 (+ 3320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:09:33.988620 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:09:33.988626 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:09:33.988651 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:09:33.990058 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:33.990535 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:33.990538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:33.990539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:33.990622 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:33.991003 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:33.991006 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:33.991007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:33.991200 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:09:33.991276 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:33.991777 (+ 501us) server_negotiation.cc:299] Negotiation successful
0812 11:09:33.991888 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2610,"thread_start_us":74,"threads_started":1}
I20260812 11:09:33.992905 16700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:33.977736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:58371)
0812 11:09:33.978479 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:33.978570 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:33.980302 (+ 1732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:33.981181 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:33.981192 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:33.981650 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:09:33.982270 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:33.982289 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.983243 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.983246 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:33.984750 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:33.984760 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:33.985358 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:33.985361 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:33.985612 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:33.986289 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:09:33.986309 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:09:33.988433 (+ 2124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:09:33.990148 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:33.990152 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:33.990166 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:33.990417 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:33.990730 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:33.990733 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:33.990735 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:33.990890 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:33.991277 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:09:33.991282 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:09:33.991544 (+ 262us) client_negotiation.cc:769] Sending connection context
0812 11:09:33.991702 (+ 158us) client_negotiation.cc:240] Negotiation successful
0812 11:09:33.991980 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":145,"threads_started":1}
I20260812 11:09:33.994050 16694 heartbeater.cc:347] Connected to a master server at 127.18.174.254:40545
I20260812 11:09:33.994279 16694 heartbeater.cc:464] Registering TS with master...
I20260812 11:09:33.994755 16694 heartbeater.cc:511] Master 127.18.174.254:40545 requested a full tablet report, sending...
I20260812 11:09:33.995829 15857 ts_manager.cc:194] Registered new tserver with Master: a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473)
I20260812 11:09:33.996483 15857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:58371
I20260812 11:09:34.000154 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:09:34.004501 16698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:34.000825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58462 (local address 127.18.174.254:40545)
0812 11:09:34.000961 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:34.000964 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:34.001100 (+ 136us) server_negotiation.cc:407] Connection header received
0812 11:09:34.001242 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:34.001244 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:34.001384 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:34.001475 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:09:34.001740 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.002258 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.003218 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.003533 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.003619 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:34.003919 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:09:34.004070 (+ 151us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 11:09:34.004389 (+ 319us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58462: token expired
Metrics: {"server-negotiator.queue_time_us":57}
W20260812 11:09:34.004570 16698 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58462: token expired
W20260812 11:09:34.004912 15718 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.18.174.254:40545)
I20260812 11:09:34.012255 16698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:34.005264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58464 (local address 127.18.174.254:40545)
0812 11:09:34.005419 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:34.005422 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:34.005436 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:09:34.005527 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:34.005529 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:34.005568 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:34.005627 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:09:34.006200 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.006822 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.007616 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.007821 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.007899 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:34.009209 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:09:34.009212 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:09:34.009214 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:09:34.009240 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:09:34.010696 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:34.011077 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:34.011079 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:34.011081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:34.011152 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:34.011335 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:34.011337 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:34.011338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:34.011506 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:09:34.011603 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:34.011952 (+ 349us) server_negotiation.cc:299] Negotiation successful
0812 11:09:34.012109 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 11:09:34.015034 15857 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58464:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:09:34.018549 15857 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:09:34.027096 16078 tablet_service.cc:1467] Processing CreateTablet for tablet 8914eb0170f4424e92930f248266f962 (DEFAULT_TABLE table=test-table [id=c4a85381ab7e4c869cae28ff45fff3b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:09:34.027791 16078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8914eb0170f4424e92930f248266f962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:09:34.030848 16009 tablet_bootstrap.cc:492] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd: Bootstrap starting.
I20260812 11:09:34.031322 16224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:34.025772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45473 (local address 127.0.0.1:37034)
0812 11:09:34.025915 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:34.025932 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:34.026020 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:34.026992 (+ 972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:34.026995 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:34.027015 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:09:34.027128 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:34.027134 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.028637 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.028641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:34.029817 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:34.029829 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.030888 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.030892 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:34.030990 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:34.031045 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 11:09:34.031101 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 11:09:34.031186 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 11:09:34.031850 16009 tablet_bootstrap.cc:654] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd: Neither blocks nor log segments found. Creating new log.
I20260812 11:09:34.031934 16713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:34.026082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:38043 (local address 127.0.0.1:50554)
0812 11:09:34.026333 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:34.026348 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:34.026448 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:34.027986 (+ 1538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:34.027989 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:34.028008 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:09:34.028119 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:34.028125 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.029353 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.029357 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:34.030226 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:34.030237 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.031531 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.031535 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:34.031636 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:34.031661 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:09:34.031725 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 11:09:34.031796 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":109,"threads_started":1}
I20260812 11:09:34.031965 16714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:34.026032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37034 (local address 127.18.174.195:45473)
0812 11:09:34.026444 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:34.026463 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:34.026487 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:09:34.026577 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:34.026583 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:34.026841 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:34.027001 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:09:34.027263 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.028516 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.029965 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.030744 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.031523 (+ 779us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:34.031660 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:34.031718 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 11:09:34.031818 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":166,"threads_started":1}
I20260812 11:09:34.032363 16716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:34.026915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50554 (local address 127.18.174.194:38043)
0812 11:09:34.027330 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:34.027341 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:34.027376 (+ 35us) server_negotiation.cc:407] Connection header received
0812 11:09:34.027455 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:34.027460 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:34.027663 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:34.027813 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:09:34.028238 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.029245 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.030359 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.031190 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.031328 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:34.031470 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:34.032110 (+ 640us) server_negotiation.cc:299] Negotiation successful
0812 11:09:34.032211 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":117,"threads_started":1}
I20260812 11:09:34.033375 16009 tablet_bootstrap.cc:492] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd: No bootstrap required, opened a new log
I20260812 11:09:34.033469 16009 ts_tablet_manager.cc:1397] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:09:34.033922 16009 raft_consensus.cc:348] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:34.034024 16009 raft_consensus.cc:374] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:09:34.034062 16009 raft_consensus.cc:729] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6cdf076b5f84b5986b3e5acbbfe52dd, State: Initialized, Role: FOLLOWER
I20260812 11:09:34.033812 16335 tablet_service.cc:1467] Processing CreateTablet for tablet 8914eb0170f4424e92930f248266f962 (DEFAULT_TABLE table=test-table [id=c4a85381ab7e4c869cae28ff45fff3b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:09:34.034310 16009 consensus_queue.cc:260] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:34.034631 16009 ts_tablet_manager.cc:1428] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 11:09:34.034971 16335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8914eb0170f4424e92930f248266f962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:09:34.035362 16576 tablet_service.cc:1467] Processing CreateTablet for tablet 8914eb0170f4424e92930f248266f962 (DEFAULT_TABLE table=test-table [id=c4a85381ab7e4c869cae28ff45fff3b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:09:34.036506 16576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8914eb0170f4424e92930f248266f962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:09:34.040356 16266 tablet_bootstrap.cc:492] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935: Bootstrap starting.
I20260812 11:09:34.042425 16266 tablet_bootstrap.cc:654] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935: Neither blocks nor log segments found. Creating new log.
I20260812 11:09:34.043232 16266 log.cc:824] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935: Log is configured to *not* fsync() on all Append() calls
I20260812 11:09:34.044826 16721 tablet_bootstrap.cc:492] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1: Bootstrap starting.
I20260812 11:09:34.045625 16266 tablet_bootstrap.cc:492] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935: No bootstrap required, opened a new log
I20260812 11:09:34.045814 16266 ts_tablet_manager.cc:1397] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:09:34.047443 16721 tablet_bootstrap.cc:654] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1: Neither blocks nor log segments found. Creating new log.
I20260812 11:09:34.048300 16721 log.cc:824] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1: Log is configured to *not* fsync() on all Append() calls
I20260812 11:09:34.049000 16266 raft_consensus.cc:348] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:34.049259 16266 raft_consensus.cc:374] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:09:34.049322 16266 raft_consensus.cc:729] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba784a02b8694cb7acf60b0e7c913935, State: Initialized, Role: FOLLOWER
I20260812 11:09:34.049777 16266 consensus_queue.cc:260] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:34.050550 16459 heartbeater.cc:503] Master 127.18.174.254:40545 was elected leader, sending a full tablet report...
I20260812 11:09:34.050848 16721 tablet_bootstrap.cc:492] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1: No bootstrap required, opened a new log
I20260812 11:09:34.050894 16266 ts_tablet_manager.cc:1428] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 11:09:34.051069 16721 ts_tablet_manager.cc:1397] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260812 11:09:34.054448 16721 raft_consensus.cc:348] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:34.054733 16721 raft_consensus.cc:374] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:09:34.054783 16721 raft_consensus.cc:729] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54ed96b250c4825bf13e3ba2429c7b1, State: Initialized, Role: FOLLOWER
I20260812 11:09:34.055236 16721 consensus_queue.cc:260] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:34.055987 16694 heartbeater.cc:503] Master 127.18.174.254:40545 was elected leader, sending a full tablet report...
I20260812 11:09:34.056201 16721 ts_tablet_manager.cc:1428] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
W20260812 11:09:34.062942 16214 tablet.cc:2369] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:09:34.063024 16726 raft_consensus.cc:482] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:09:34.063208 16726 raft_consensus.cc:504] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:34.064329 16726 leader_election.cc:288] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473), e6cdf076b5f84b5986b3e5acbbfe52dd (127.18.174.193:32847)
I20260812 11:09:34.068418 16462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:34.064600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45473 (local address 127.18.174.194:37669)
0812 11:09:34.064735 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:34.064752 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:34.064847 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:34.065108 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:34.065111 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:34.065132 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:09:34.065269 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:34.065277 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.066267 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.066271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:34.067170 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:34.067181 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.067936 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.067940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:34.068055 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:34.068113 (+ 58us) client_negotiation.cc:769] Sending connection context
0812 11:09:34.068199 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 11:09:34.068280 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 11:09:34.068418 16714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:34.064663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:37669 (local address 127.18.174.195:45473)
0812 11:09:34.064777 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:34.064782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:34.064795 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:09:34.064944 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:34.064946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:34.064993 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:34.065381 (+ 388us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:09:34.065494 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.066141 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.067292 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.067813 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.067905 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:34.067950 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:34.068211 (+ 261us) server_negotiation.cc:299] Negotiation successful
0812 11:09:34.068278 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:09:34.069010 16226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:34.065047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:51037 (local address 127.18.174.193:32847)
0812 11:09:34.065172 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:34.065176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:34.065282 (+ 106us) server_negotiation.cc:407] Connection header received
0812 11:09:34.065383 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:34.065386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:34.065448 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:34.065548 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:09:34.065817 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.066529 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.067624 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.068202 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.068307 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:34.068503 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:34.068824 (+ 321us) server_negotiation.cc:299] Negotiation successful
0812 11:09:34.068904 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:09:34.069025 16728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:34.064872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:32847 (local address 127.18.174.194:51037)
0812 11:09:34.065202 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:34.065214 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:34.065305 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:34.065571 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:34.065574 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:34.065589 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:09:34.065708 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:34.065715 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.066638 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.066641 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:34.067494 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:34.067505 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.068301 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.068305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:34.068404 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:34.068428 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:09:34.068792 (+ 364us) client_negotiation.cc:240] Negotiation successful
0812 11:09:34.068867 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":1,"thread_start_us":133,"threads_started":1}
I20260812 11:09:34.069059 16610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8914eb0170f4424e92930f248266f962" candidate_uuid: "ba784a02b8694cb7acf60b0e7c913935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" is_pre_election: true
I20260812 11:09:34.069422 16610 raft_consensus.cc:2454] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba784a02b8694cb7acf60b0e7c913935 in term 0.
I20260812 11:09:34.069949 16257 leader_election.cc:302] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54ed96b250c4825bf13e3ba2429c7b1, ba784a02b8694cb7acf60b0e7c913935; no voters:
I20260812 11:09:34.070233 16726 raft_consensus.cc:2781] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:09:34.070202 16124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8914eb0170f4424e92930f248266f962" candidate_uuid: "ba784a02b8694cb7acf60b0e7c913935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" is_pre_election: true
I20260812 11:09:34.070317 16726 raft_consensus.cc:482] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:09:34.070349 16726 raft_consensus.cc:3037] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:09:34.070482 16124 raft_consensus.cc:2454] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba784a02b8694cb7acf60b0e7c913935 in term 0.
I20260812 11:09:34.071537 16726 raft_consensus.cc:504] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:34.071899 16726 leader_election.cc:288] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [CANDIDATE]: Term 1 election: Requested vote from peers a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473), e6cdf076b5f84b5986b3e5acbbfe52dd (127.18.174.193:32847)
I20260812 11:09:34.072294 16610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8914eb0170f4424e92930f248266f962" candidate_uuid: "ba784a02b8694cb7acf60b0e7c913935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54ed96b250c4825bf13e3ba2429c7b1"
I20260812 11:09:34.072293 16124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8914eb0170f4424e92930f248266f962" candidate_uuid: "ba784a02b8694cb7acf60b0e7c913935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd"
I20260812 11:09:34.072417 16610 raft_consensus.cc:3037] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:09:34.072422 16124 raft_consensus.cc:3037] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:09:34.073447 16610 raft_consensus.cc:2454] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba784a02b8694cb7acf60b0e7c913935 in term 1.
I20260812 11:09:34.073478 16124 raft_consensus.cc:2454] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba784a02b8694cb7acf60b0e7c913935 in term 1.
I20260812 11:09:34.073724 16257 leader_election.cc:302] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba784a02b8694cb7acf60b0e7c913935, e6cdf076b5f84b5986b3e5acbbfe52dd; no voters:
I20260812 11:09:34.073894 16726 raft_consensus.cc:2781] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:09:34.074160 16726 raft_consensus.cc:686] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [term 1 LEADER]: Becoming Leader. State: Replica: ba784a02b8694cb7acf60b0e7c913935, State: Running, Role: LEADER
I20260812 11:09:34.074512 16726 consensus_queue.cc:237] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:34.077844 15856 catalog_manager.cc:5495] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194). New cstate: current_term: 1 leader_uuid: "ba784a02b8694cb7acf60b0e7c913935" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } health_report { overall_health: UNKNOWN } } }
I20260812 11:09:34.098240 16716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:34.094926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50568 (local address 127.18.174.194:38043)
0812 11:09:34.095055 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:34.095059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:34.095073 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:09:34.095155 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:34.095157 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:34.095217 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:34.095309 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:09:34.095569 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.096134 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.096939 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:34.097158 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:34.097232 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:34.097498 (+ 266us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:09:34.097929 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:09:34.098021 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:34.098049 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 11:09:34.098101 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:09:34.104504 16124 raft_consensus.cc:1261] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Refusing update from remote peer ba784a02b8694cb7acf60b0e7c913935: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:09:34.104506 16610 raft_consensus.cc:1261] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1 [term 1 FOLLOWER]: Refusing update from remote peer ba784a02b8694cb7acf60b0e7c913935: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:09:34.105314 16729 consensus_queue.cc:1035] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:09:34.105563 16726 consensus_queue.cc:1035] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:09:34.111946 16732 mvcc.cc:205] Tried to move back new op lower bound from 7317639061923676160 to 7317639061811879936. Current Snapshot: MvccSnapshot[applied={T|T < 7317639061923676160}]
I20260812 11:09:34.113746 16734 mvcc.cc:205] Tried to move back new op lower bound from 7317639061923676160 to 7317639061811879936. Current Snapshot: MvccSnapshot[applied={T|T < 7317639061923676160}]
I20260812 11:09:34.120249 16735 mvcc.cc:205] Tried to move back new op lower bound from 7317639061923676160 to 7317639061811879936. Current Snapshot: MvccSnapshot[applied={T|T < 7317639061923676160 or (T in {7317639061923676160})}]
I20260812 11:09:34.121539 15856 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:09:34.121695 15856 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:09:34.124209 15856 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Sending DeleteTablet for 3 replicas of tablet 8914eb0170f4424e92930f248266f962
I20260812 11:09:34.124974 16576 tablet_service.cc:1514] Processing DeleteTablet for tablet 8914eb0170f4424e92930f248266f962 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:09:34 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:37034
I20260812 11:09:34.124963 16335 tablet_service.cc:1514] Processing DeleteTablet for tablet 8914eb0170f4424e92930f248266f962 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:09:34 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:50554
I20260812 11:09:34.125032 16078 tablet_service.cc:1514] Processing DeleteTablet for tablet 8914eb0170f4424e92930f248266f962 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:09:34 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:49942
I20260812 11:09:34.125456 16745 tablet_replica.cc:330] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd: stopping tablet replica
I20260812 11:09:34.125583 16745 raft_consensus.cc:2229] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:09:34.125720 16745 raft_consensus.cc:2258] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:09:34.125734 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 15938
I20260812 11:09:34.153513 16749 tablet_replica.cc:330] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1: stopping tablet replica
I20260812 11:09:34.153930 16749 raft_consensus.cc:2229] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:09:34.154268 16749 raft_consensus.cc:2258] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:09:34.154891 16750 tablet_replica.cc:330] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935: stopping tablet replica
I20260812 11:09:34.155254 16750 raft_consensus.cc:2229] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:09:34.155670 16750 raft_consensus.cc:2258] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:09:34.156620 16749 ts_tablet_manager.cc:1905] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:09:34.157210 16750 ts_tablet_manager.cc:1905] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:09:34.159457 16749 ts_tablet_manager.cc:1918] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:09:34.159569 16749 log.cc:1196] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/8914eb0170f4424e92930f248266f962
I20260812 11:09:34.159790 16750 ts_tablet_manager.cc:1918] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:09:34.159878 16750 log.cc:1196] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/8914eb0170f4424e92930f248266f962
I20260812 11:09:34.159917 16749 ts_tablet_manager.cc:1939] T 8914eb0170f4424e92930f248266f962 P a54ed96b250c4825bf13e3ba2429c7b1: Deleting consensus metadata
I20260812 11:09:34.160162 16750 ts_tablet_manager.cc:1939] T 8914eb0170f4424e92930f248266f962 P ba784a02b8694cb7acf60b0e7c913935: Deleting consensus metadata
I20260812 11:09:34.161334 15832 catalog_manager.cc:4841] TS ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194:38043): tablet 8914eb0170f4424e92930f248266f962 (table test-table [id=c4a85381ab7e4c869cae28ff45fff3b5]) successfully deleted
I20260812 11:09:34.161541 15832 catalog_manager.cc:4841] TS a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473): tablet 8914eb0170f4424e92930f248266f962 (table test-table [id=c4a85381ab7e4c869cae28ff45fff3b5]) successfully deleted
W20260812 11:09:34.163287 15832 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:32847 (error 108)
I20260812 11:09:34.163890 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 16219
I20260812 11:09:34.169407 16713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:34.169084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:32847 (local address 127.0.0.1:49946)
0812 11:09:34.169220 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:34.169308 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:32847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 11:09:34.169732 15832 catalog_manager.cc:4584] TS e6cdf076b5f84b5986b3e5acbbfe52dd (127.18.174.193:32847): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8914eb0170f4424e92930f248266f962: Network error: Client connection negotiation failed: client connection to 127.18.174.193:32847: connect: Connection refused (error 111)
I20260812 11:09:34.175464 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 16463
I20260812 11:09:34.198262 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 15797
I20260812 11:09:54.213555 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:40545
--webserver_interface=127.18.174.254
--webserver_port=39629
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:38191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:40545
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:09:54.334268 16754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:09:54.334578 16754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:09:54.334621 16754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:09:54.338872 16754 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 11:09:54.338946 16754 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 11:09:54.338963 16754 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 11:09:54.338975 16754 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:09:54.338992 16754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:09:54.339013 16754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:09:54.339041 16754 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:09:54.339071 16754 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:09:54.344699 16754 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:38191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:40545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:40545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=39629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:09:54.345889 16754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:09:54.346973 16754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:09:54.356850 16768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:54.356914 16773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:54.356881 16754 server_base.cc:1034] running on GCE node
W20260812 11:09:54.356871 16771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:54.357712 16754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:09:54.359000 16754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:09:54.360170 16754 hybrid_clock.cc:648] HybridClock initialized: now 1786532994360148 us; error 33 us; skew 500 ppm
Aug 12 11:09:54 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532994, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:09:54.368441 16754 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:09:54.369841 16754 webserver.cc:460] Webserver started at http://127.18.174.254:39629/ using document root <none> and password file <none>
I20260812 11:09:54.370625 16754 fs_manager.cc:359] Metadata directory not provided
I20260812 11:09:54.370790 16754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:09:54.376843 16754 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:09:54.379725 16785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:54.381632 16754 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:09:54.381775 16754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "a3b352009e114604bdca471ae5c3698c"
format_stamp: "Formatted at 2026-08-12 11:09:11 on dist-test-slave-lgr5"
server_key: "7ebc1ad42b386e2165fd39c81708be76"
server_key_iv: "5a4ad02a79b88704abb4e93f9fe093e9"
server_key_version: "encryptionkey@0"
I20260812 11:09:54.382380 16754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:09:54.396684 16754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:09:54.404301 16754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:09:54.404554 16754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:09:54.415148 16754 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:40545
I20260812 11:09:54.415437 16879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:40545 every 8 connection(s)
I20260812 11:09:54.416453 16754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:09:54.421119 16882 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:09:54.422260 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 16754
I20260812 11:09:54.422704 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:32847
--local_ip_for_outbound_sockets=127.18.174.193
--tserver_master_addrs=127.18.174.254:40545
--webserver_port=37405
--webserver_interface=127.18.174.193
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:38191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:09:54.422960 16882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Bootstrap starting.
I20260812 11:09:54.441679 16882 log.cc:824] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:09:54.454082 16882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:09:54.454670 16882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: Bootstrap complete.
I20260812 11:09:54.460736 16882 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } }
I20260812 11:09:54.461369 16882 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3b352009e114604bdca471ae5c3698c, State: Initialized, Role: FOLLOWER
I20260812 11:09:54.462033 16882 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } }
I20260812 11:09:54.462200 16882 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:09:54.462337 16882 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:09:54.462458 16882 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 2 FOLLOWER]: Advancing to term 3
I20260812 11:09:54.465143 16882 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } }
I20260812 11:09:54.465598 16882 leader_election.cc:302] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3b352009e114604bdca471ae5c3698c; no voters:
I20260812 11:09:54.466053 16882 leader_election.cc:288] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 11:09:54.466138 16888 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 3 FOLLOWER]: Leader election won for term 3
I20260812 11:09:54.466324 16888 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [term 3 LEADER]: Becoming Leader. State: Replica: a3b352009e114604bdca471ae5c3698c, State: Running, Role: LEADER
I20260812 11:09:54.466699 16888 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } }
I20260812 11:09:54.467370 16882 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:09:54.467691 16888 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3b352009e114604bdca471ae5c3698c. Latest consensus state: current_term: 3 leader_uuid: "a3b352009e114604bdca471ae5c3698c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } } }
I20260812 11:09:54.468502 16888 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [sys.catalog]: This master's current role is: LEADER
I20260812 11:09:54.468375 16889 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "a3b352009e114604bdca471ae5c3698c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3b352009e114604bdca471ae5c3698c" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40545 } } }
I20260812 11:09:54.469259 16889 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c [sys.catalog]: This master's current role is: LEADER
I20260812 11:09:54.472947 16919 catalog_manager.cc:1259] Loaded cluster ID: f24b774913464ba6b102b38d85b1ec4d
I20260812 11:09:54.473062 16919 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: loading cluster ID for follower catalog manager: success
I20260812 11:09:54.475947 16919 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a3b352009e114604bdca471ae5c3698c: acquiring CA information for follower catalog manager: success
F20260812 11:09:54.477458 16919 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fd9c768b9ad google::LogMessage::Fail() at ??:0
@ 0x7fd9c768e88a google::LogMessage::SendToLog() at ??:0
@ 0x7fd9c768b4de google::LogMessage::Flush() at ??:0
@ 0x7fd9c768ca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fd9ca34f18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fd9d1ff0989 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7fd9d1fcd023 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7fd9d1fcd54b kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7fd9d1fc6652 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7fd9d1fc59e9 _ZZN4kudu6master21CatalogManagerBgTasks4InitEvENKUlvE_clEv at ??:0
@ 0x7fd9d200c541 _ZNSt17_Function_handlerIFvvEZN4kudu6master21CatalogManagerBgTasks4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fd9c98ce512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fd9caf126db start_thread at ??:0
@ 0x7fd9c618961f clone at ??:0
W20260812 11:09:54.570425 16885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:09:54.570700 16885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:09:54.570744 16885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:09:54.574821 16885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:09:54.574891 16885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:09:54.574951 16885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:09:54.580386 16885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:38191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:32847
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=37405
--tserver_master_addrs=127.18.174.254:40545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:09:54.581482 16885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:09:54.582558 16885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:09:54.592423 16955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:54.592454 16953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:54.592723 16960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:54.592772 16885 server_base.cc:1034] running on GCE node
I20260812 11:09:54.593209 16885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:09:54.593870 16885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:09:54.595053 16885 hybrid_clock.cc:648] HybridClock initialized: now 1786532994595025 us; error 38 us; skew 500 ppm
Aug 12 11:09:54 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532994, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:09:54.598097 16885 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:09:54.599241 16885 webserver.cc:460] Webserver started at http://127.18.174.193:37405/ using document root <none> and password file <none>
I20260812 11:09:54.600023 16885 fs_manager.cc:359] Metadata directory not provided
I20260812 11:09:54.600135 16885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:09:54.605455 16885 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260812 11:09:54.608435 16973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:54.610024 16885 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:09:54.610164 16885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd"
format_stamp: "Formatted at 2026-08-12 11:09:12 on dist-test-slave-lgr5"
server_key: "c352eab23392207bac2b7bd452259f4a"
server_key_iv: "d013095d353658868dacd535d11500a7"
server_key_version: "encryptionkey@0"
I20260812 11:09:54.610939 16885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:09:54.649255 16885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:09:54.653497 16885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:09:54.653723 16885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:09:54.654516 16885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:09:54.655973 16987 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 11:09:54.660411 16885 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 11:09:54.660506 16885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260812 11:09:54.660578 16885 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 11:09:54.662961 16885 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 11:09:54.663028 16885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260812 11:09:54.663378 16987 tablet_bootstrap.cc:492] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd: Bootstrap starting.
I20260812 11:09:54.673949 16885 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:32847
I20260812 11:09:54.674296 17179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:32847 every 8 connection(s)
I20260812 11:09:54.675190 16885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:09:54.681661 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 16885
I20260812 11:09:54.682212 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:38043
--local_ip_for_outbound_sockets=127.18.174.194
--tserver_master_addrs=127.18.174.254:40545
--webserver_port=37815
--webserver_interface=127.18.174.194
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:38191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:09:54.683063 16987 log.cc:824] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd: Log is configured to *not* fsync() on all Append() calls
I20260812 11:09:54.692750 16987 tablet_bootstrap.cc:492] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:09:54.693225 16987 tablet_bootstrap.cc:492] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd: Bootstrap complete.
I20260812 11:09:54.694550 16987 ts_tablet_manager.cc:1397] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd: Time spent bootstrapping tablet: real 0.031s user 0.023s sys 0.005s
I20260812 11:09:54.697891 16987 raft_consensus.cc:348] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:54.698443 16987 raft_consensus.cc:729] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6cdf076b5f84b5986b3e5acbbfe52dd, State: Initialized, Role: FOLLOWER
I20260812 11:09:54.698977 16987 consensus_queue.cc:260] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:54.700023 16987 ts_tablet_manager.cc:1428] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd: Time spent starting tablet: real 0.005s user 0.006s sys 0.001s
W20260812 11:09:54.703444 17186 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:09:54.677678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:34791)
0812 11:09:54.678294 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:54.678359 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:54.679452 (+ 1093us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:54.702512 (+ 23060us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":147,"threads_started":1}
W20260812 11:09:54.703994 17183 heartbeater.cc:644] Failed to heartbeat to 127.18.174.254:40545 (0 consecutive failures): Network error: Failed to ping master at 127.18.174.254:40545: Client connection negotiation failed: client connection to 127.18.174.254:40545: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 11:09:54.704731 17186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:54.704448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:39133)
0812 11:09:54.704591 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:54.704663 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 11:09:54.705312 17186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:54.705112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:55189)
0812 11:09:54.705204 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:54.705249 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 11:09:54.705469 17183 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:09:54.803438 17191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:09:54.803750 17191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:09:54.803802 17191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:09:54.807838 17191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:09:54.807901 17191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:09:54.807960 17191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:09:54.813300 17191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:38191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:38043
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=37815
--tserver_master_addrs=127.18.174.254:40545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:09:54.814363 17191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:09:54.815364 17191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:09:54.825191 17200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:54.825306 17191 server_base.cc:1034] running on GCE node
W20260812 11:09:54.825201 17205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:54.825201 17202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:54.825968 17191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:09:54.826671 17191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:09:54.827857 17191 hybrid_clock.cc:648] HybridClock initialized: now 1786532994827838 us; error 29 us; skew 500 ppm
Aug 12 11:09:54 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532994, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:09:54.830667 17191 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:09:54.831578 17191 webserver.cc:460] Webserver started at http://127.18.174.194:37815/ using document root <none> and password file <none>
I20260812 11:09:54.832191 17191 fs_manager.cc:359] Metadata directory not provided
I20260812 11:09:54.832265 17191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:09:54.836328 17191 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:09:54.838507 17213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:54.839805 17191 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:09:54.839923 17191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "ba784a02b8694cb7acf60b0e7c913935"
format_stamp: "Formatted at 2026-08-12 11:09:12 on dist-test-slave-lgr5"
server_key: "4e7561cb33290e13210f90de42d669c1"
server_key_iv: "39a18766634174b18fa8519a2dd2926e"
server_key_version: "encryptionkey@0"
I20260812 11:09:54.840579 17191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:09:54.864441 17191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:09:54.867694 17191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:09:54.867884 17191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:09:54.868559 17191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:09:54.869467 17191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:09:54.869517 17191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:54.869573 17191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:09:54.869597 17191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:54.878319 17426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:38043 every 8 connection(s)
I20260812 11:09:54.878316 17191 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:38043
I20260812 11:09:54.879410 17191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:09:54.880689 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 17191
I20260812 11:09:54.881203 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:45473
--local_ip_for_outbound_sockets=127.18.174.195
--tserver_master_addrs=127.18.174.254:40545
--webserver_port=36829
--webserver_interface=127.18.174.195
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:38191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:09:54.884243 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:54.881952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:42275)
0812 11:09:54.882499 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:54.882615 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":149,"threads_started":1}
W20260812 11:09:54.884758 17427 heartbeater.cc:644] Failed to heartbeat to 127.18.174.254:40545 (0 consecutive failures): Network error: Failed to ping master at 127.18.174.254:40545: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
I20260812 11:09:54.885504 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:54.885214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:52415)
0812 11:09:54.885365 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:54.885424 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 11:09:54.886147 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:54.885955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:50827)
0812 11:09:54.886050 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:54.886093 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 11:09:54.886338 17427 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:09:54.999166 17433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:09:54.999460 17433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:09:54.999503 17433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:09:55.003569 17433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:09:55.003643 17433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:09:55.003703 17433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:09:55.009218 17433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:38191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:45473
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=36829
--tserver_master_addrs=127.18.174.254:40545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:09:55.010360 17433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:09:55.011433 17433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:09:55.021920 17439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:55.021920 17443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:55.021920 17438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:55.022259 17433 server_base.cc:1034] running on GCE node
I20260812 11:09:55.022666 17433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:09:55.023299 17433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:09:55.024451 17433 hybrid_clock.cc:648] HybridClock initialized: now 1786532995024421 us; error 43 us; skew 500 ppm
Aug 12 11:09:55 dist-test-slave-lgr5 krb5kdc[14809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532995, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:09:55.027227 17433 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:09:55.028187 17433 webserver.cc:460] Webserver started at http://127.18.174.195:36829/ using document root <none> and password file <none>
I20260812 11:09:55.028767 17433 fs_manager.cc:359] Metadata directory not provided
I20260812 11:09:55.028836 17433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:09:55.033061 17433 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:09:55.035519 17457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:55.036994 17433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:09:55.037122 17433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "a54ed96b250c4825bf13e3ba2429c7b1"
format_stamp: "Formatted at 2026-08-12 11:09:12 on dist-test-slave-lgr5"
server_key: "a2736cb2b87ff377511661260229a622"
server_key_iv: "7035539b7d06541ab7fa27551efe2b37"
server_key_version: "encryptionkey@0"
I20260812 11:09:55.037712 17433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:09:55.058265 17433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:09:55.061407 17433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:09:55.061587 17433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:09:55.062214 17433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:09:55.063097 17433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:09:55.063143 17433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:55.063184 17433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:09:55.063215 17433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:55.072247 17433 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:45473
I20260812 11:09:55.072278 17655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:45473 every 8 connection(s)
I20260812 11:09:55.073325 17433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:09:55.077337 17659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:55.075574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:54065)
0812 11:09:55.076064 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:55.076528 (+ 464us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":121,"threads_started":1}
W20260812 11:09:55.077932 17656 heartbeater.cc:644] Failed to heartbeat to 127.18.174.254:40545 (0 consecutive failures): Network error: Failed to ping master at 127.18.174.254:40545: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
I20260812 11:09:55.078639 17659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:55.078401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:34971)
0812 11:09:55.078523 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:55.078578 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 11:09:55.079285 17659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:55.079039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:58113)
0812 11:09:55.079167 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:55.079221 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 11:09:55.079466 17656 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 11:09:55.080227 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 17433
I20260812 11:09:55.706547 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:55.706092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:34317)
0812 11:09:55.706362 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:55.706429 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":78,"threads_started":1}
I20260812 11:09:55.887310 17666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:55.886896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:55363)
0812 11:09:55.887146 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:55.887203 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":74,"threads_started":1}
I20260812 11:09:56.080615 17667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:56.080123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:48947)
0812 11:09:56.080410 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:56.080486 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":70,"threads_started":1}
I20260812 11:09:56.219359 17669 raft_consensus.cc:482] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:09:56.219692 17669 raft_consensus.cc:504] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:56.221046 17669 leader_election.cc:288] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473), ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194:38043)
Aug 12 11:09:56 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532994, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.194@KRBTEST.COM
Aug 12 11:09:56 dist-test-slave-lgr5 krb5kdc[14809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532994, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.195@KRBTEST.COM
I20260812 11:09:56.236908 17672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:56.221276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:45473 (local address 127.18.174.193:54019)
0812 11:09:56.221545 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:56.221562 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:56.221668 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:56.223464 (+ 1796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:56.223470 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:56.224032 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:09:56.224542 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:56.224557 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:56.225946 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:56.225949 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:56.226896 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:56.226907 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:56.227855 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:56.227859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:56.228124 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:56.228844 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:09:56.228856 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:09:56.231093 (+ 2237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:09:56.233455 (+ 2362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:56.233463 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:56.233480 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:56.234010 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:56.234488 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:56.234492 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:56.234494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:56.234752 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:56.235681 (+ 929us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:09:56.235689 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:09:56.236057 (+ 368us) client_negotiation.cc:769] Sending connection context
0812 11:09:56.236340 (+ 283us) client_negotiation.cc:240] Negotiation successful
0812 11:09:56.236699 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":232,"spinlock_wait_cycles":65280,"thread_start_us":62,"threads_started":1}
I20260812 11:09:56.236912 17675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:56.221635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:38043 (local address 127.18.174.193:42923)
0812 11:09:56.221889 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:56.221899 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 11:09:56.221981 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:09:56.223463 (+ 1482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:09:56.223469 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:09:56.224043 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:09:56.224543 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:56.224558 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:56.225905 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:56.225909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:56.226889 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:09:56.226901 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:09:56.227855 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:09:56.227859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:09:56.228124 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:56.228803 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:09:56.228832 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:09:56.230745 (+ 1913us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:09:56.233455 (+ 2710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:56.233463 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:56.233480 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:56.234027 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:56.234488 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:09:56.234492 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:09:56.234494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:09:56.234752 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:09:56.235681 (+ 929us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:09:56.235689 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:09:56.236057 (+ 368us) client_negotiation.cc:769] Sending connection context
0812 11:09:56.236317 (+ 260us) client_negotiation.cc:240] Negotiation successful
0812 11:09:56.236767 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":347,"spinlock_wait_cycles":58496,"thread_start_us":80,"threads_started":1}
I20260812 11:09:56.236981 17674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:56.221416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:54019 (local address 127.18.174.195:45473)
0812 11:09:56.221830 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:56.221860 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:56.221908 (+ 48us) server_negotiation.cc:407] Connection header received
0812 11:09:56.222690 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:56.222696 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:56.223047 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:56.223349 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:09:56.224712 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:56.225749 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:56.227082 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:56.227728 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:56.227894 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:56.231311 (+ 3417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:09:56.231317 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:09:56.231334 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:09:56.231370 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:09:56.233322 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:56.234156 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:56.234163 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:56.234169 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:56.234375 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:56.234864 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:56.234867 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:56.234869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:56.235528 (+ 659us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:09:56.235672 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:56.236471 (+ 799us) server_negotiation.cc:299] Negotiation successful
0812 11:09:56.236793 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":71,"threads_started":1}
I20260812 11:09:56.237741 17677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:56.221843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:42923 (local address 127.18.174.194:38043)
0812 11:09:56.222195 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:56.222213 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:56.222242 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:09:56.222868 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:56.222873 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:56.223186 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:56.223468 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:09:56.224713 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:56.225708 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:56.227018 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:56.227728 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:56.227894 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:56.230986 (+ 3092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:09:56.230993 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:09:56.231009 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:09:56.231040 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:09:56.233271 (+ 2231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:56.234157 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:56.234163 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:56.234169 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:56.234354 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:56.234867 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:56.234870 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:56.234871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:56.235535 (+ 664us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:09:56.235672 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:56.236471 (+ 799us) server_negotiation.cc:299] Negotiation successful
0812 11:09:56.236785 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":89,"threads_started":1}
W20260812 11:09:56.239851 16978 leader_election.cc:341] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473): Not found: Tablet not found: 8914eb0170f4424e92930f248266f962
W20260812 11:09:56.240125 16978 leader_election.cc:341] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194:38043): Not found: Tablet not found: 8914eb0170f4424e92930f248266f962
I20260812 11:09:56.240193 16978 leader_election.cc:302] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6cdf076b5f84b5986b3e5acbbfe52dd; no voters: a54ed96b250c4825bf13e3ba2429c7b1, ba784a02b8694cb7acf60b0e7c913935
I20260812 11:09:56.240468 17669 raft_consensus.cc:2726] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:09:56.707690 17675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:56.707331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:48635)
0812 11:09:56.707517 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:56.707586 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260812 11:09:56.888444 17679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:56.888019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:49015)
0812 11:09:56.888283 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:56.888339 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":106,"threads_started":1}
I20260812 11:09:57.081941 17680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:57.081438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:60137)
0812 11:09:57.081753 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:57.081826 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":85,"threads_started":1}
I20260812 11:09:57.711597 17682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:57.708516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:43289)
0812 11:09:57.711427 (+ 2911us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:57.711496 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2819,"thread_start_us":2715,"threads_started":1}
I20260812 11:09:57.889683 17683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:57.889207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:36449)
0812 11:09:57.889508 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:57.889572 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":87,"threads_started":1}
I20260812 11:09:58.013984 17684 raft_consensus.cc:482] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:09:58.014143 17684 raft_consensus.cc:504] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:58.014569 17684 leader_election.cc:288] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473), ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194:38043)
W20260812 11:09:58.015563 16978 leader_election.cc:341] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194:38043): Not found: Tablet not found: 8914eb0170f4424e92930f248266f962
W20260812 11:09:58.015697 16978 leader_election.cc:341] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473): Not found: Tablet not found: 8914eb0170f4424e92930f248266f962
I20260812 11:09:58.015748 16978 leader_election.cc:302] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6cdf076b5f84b5986b3e5acbbfe52dd; no voters: a54ed96b250c4825bf13e3ba2429c7b1, ba784a02b8694cb7acf60b0e7c913935
I20260812 11:09:58.015890 17684 raft_consensus.cc:2726] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:09:58.083324 17685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:58.082870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:58733)
0812 11:09:58.083144 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:58.083208 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":85,"threads_started":1}
I20260812 11:09:58.712968 17688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:58.712476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:45001)
0812 11:09:58.712798 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:58.712865 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":87,"threads_started":1}
I20260812 11:09:58.890981 17689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:58.890519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:58841)
0812 11:09:58.890812 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:58.890881 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":83,"threads_started":1}
I20260812 11:09:59.084609 17691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:59.084157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:43883)
0812 11:09:59.084446 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:59.084508 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":74,"threads_started":1}
I20260812 11:09:59.714545 17692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:59.713981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:53871)
0812 11:09:59.714345 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:59.714442 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":107,"threads_started":1}
I20260812 11:09:59.839361 17693 raft_consensus.cc:482] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:09:59.839512 17693 raft_consensus.cc:504] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:09:59.840243 17693 leader_election.cc:288] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473), ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194:38043)
W20260812 11:09:59.841073 16978 leader_election.cc:341] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473): Not found: Tablet not found: 8914eb0170f4424e92930f248266f962
W20260812 11:09:59.841238 16978 leader_election.cc:341] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194:38043): Not found: Tablet not found: 8914eb0170f4424e92930f248266f962
I20260812 11:09:59.841292 16978 leader_election.cc:302] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6cdf076b5f84b5986b3e5acbbfe52dd; no voters: a54ed96b250c4825bf13e3ba2429c7b1, ba784a02b8694cb7acf60b0e7c913935
I20260812 11:09:59.841467 17693 raft_consensus.cc:2726] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:09:59.892449 17694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:59.891924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:35379)
0812 11:09:59.892251 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0812 11:09:59.892319 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":105,"threads_started":1}
I20260812 11:10:00.085920 17695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:00.085420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:58993)
0812 11:10:00.085746 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:00.085818 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":81,"threads_started":1}
I20260812 11:10:00.715967 17697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:00.715490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:33231)
0812 11:10:00.715791 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:00.715856 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":84,"threads_started":1}
I20260812 11:10:00.893700 17699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:00.893226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:55397)
0812 11:10:00.893521 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:00.893584 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":81,"threads_started":1}
I20260812 11:10:01.087121 17700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:01.086674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:49829)
0812 11:10:01.086961 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:01.087022 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":95,"threads_started":1}
I20260812 11:10:01.717350 17701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:01.716850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:59801)
0812 11:10:01.717143 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:01.717214 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":84,"threads_started":1}
I20260812 11:10:01.895083 17702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:01.894550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:45721)
0812 11:10:01.894894 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:01.894961 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":80,"threads_started":1}
I20260812 11:10:02.088521 17704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:02.087938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:33619)
0812 11:10:02.088339 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:02.088413 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":106,"threads_started":1}
I20260812 11:10:02.718727 17708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:02.718210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:36791)
0812 11:10:02.718551 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:02.718619 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":127,"threads_started":1}
I20260812 11:10:02.896436 17709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:02.895931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:46739)
0812 11:10:02.896241 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:02.896332 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":80,"threads_started":1}
I20260812 11:10:03.089797 17714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:03.089346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:53379)
0812 11:10:03.089627 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:03.089694 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":79,"threads_started":1}
I20260812 11:10:03.720048 17715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:03.719552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:50293)
0812 11:10:03.719863 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:03.719944 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":97,"threads_started":1}
I20260812 11:10:03.897678 17716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:03.897213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:44893)
0812 11:10:03.897506 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:03.897570 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":90,"threads_started":1}
I20260812 11:10:04.091051 17718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:04.090584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:51097)
0812 11:10:04.090885 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:04.090949 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":94,"threads_started":1}
I20260812 11:10:04.689348 17719 raft_consensus.cc:482] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:04.689500 17719 raft_consensus.cc:504] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:10:04.690006 17719 leader_election.cc:288] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473), ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194:38043)
W20260812 11:10:04.690881 16978 leader_election.cc:341] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194:38043): Not found: Tablet not found: 8914eb0170f4424e92930f248266f962
W20260812 11:10:04.691013 16978 leader_election.cc:341] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473): Not found: Tablet not found: 8914eb0170f4424e92930f248266f962
I20260812 11:10:04.691071 16978 leader_election.cc:302] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6cdf076b5f84b5986b3e5acbbfe52dd; no voters: a54ed96b250c4825bf13e3ba2429c7b1, ba784a02b8694cb7acf60b0e7c913935
I20260812 11:10:04.691229 17719 raft_consensus.cc:2726] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:10:04.721414 17721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:04.720961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:50987)
0812 11:10:04.721227 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:04.721285 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":75,"threads_started":1}
I20260812 11:10:04.898975 17723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:04.898506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:43729)
0812 11:10:04.898807 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:04.898871 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":94,"threads_started":1}
I20260812 11:10:05.092403 17724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:05.091898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:58037)
0812 11:10:05.092217 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:05.092291 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":93,"threads_started":1}
I20260812 11:10:05.722549 17725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:05.722104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:41329)
0812 11:10:05.722390 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:05.722449 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":91,"threads_started":1}
I20260812 11:10:05.900311 17728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:05.899781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:50287)
0812 11:10:05.900112 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:05.900180 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":96,"threads_started":1}
I20260812 11:10:06.093631 17732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:06.093153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:50159)
0812 11:10:06.093467 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:06.093532 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":98,"threads_started":1}
I20260812 11:10:06.723695 17733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:06.723258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:54533)
0812 11:10:06.723537 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:06.723597 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":78,"threads_started":1}
I20260812 11:10:06.739025 17734 raft_consensus.cc:482] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:06.739179 17734 raft_consensus.cc:504] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:10:06.739652 17734 leader_election.cc:288] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473), ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194:38043)
W20260812 11:10:06.740533 16978 leader_election.cc:341] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473): Not found: Tablet not found: 8914eb0170f4424e92930f248266f962
W20260812 11:10:06.740691 16978 leader_election.cc:341] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194:38043): Not found: Tablet not found: 8914eb0170f4424e92930f248266f962
I20260812 11:10:06.740743 16978 leader_election.cc:302] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6cdf076b5f84b5986b3e5acbbfe52dd; no voters: a54ed96b250c4825bf13e3ba2429c7b1, ba784a02b8694cb7acf60b0e7c913935
I20260812 11:10:06.740924 17734 raft_consensus.cc:2726] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:10:06.901505 17742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:06.901062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:40665)
0812 11:10:06.901343 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:06.901403 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":76,"threads_started":1}
I20260812 11:10:07.095038 17744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:07.094524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:42467)
0812 11:10:07.094846 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:07.094920 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":86,"threads_started":1}
I20260812 11:10:07.725018 17745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:07.724531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:48033)
0812 11:10:07.724828 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:07.724912 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":85,"threads_started":1}
I20260812 11:10:07.902671 17746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:07.902255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:60875)
0812 11:10:07.902513 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:07.902570 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":76,"threads_started":1}
I20260812 11:10:08.096597 17748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:08.096045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:57213)
0812 11:10:08.096415 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:08.096489 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":89,"threads_started":1}
I20260812 11:10:08.301478 17749 raft_consensus.cc:482] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:08.301623 17749 raft_consensus.cc:504] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a54ed96b250c4825bf13e3ba2429c7b1" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 45473 } } peers { permanent_uuid: "ba784a02b8694cb7acf60b0e7c913935" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38043 } } peers { permanent_uuid: "e6cdf076b5f84b5986b3e5acbbfe52dd" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 32847 } }
I20260812 11:10:08.302044 17749 leader_election.cc:288] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473), ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194:38043)
W20260812 11:10:08.302924 16978 leader_election.cc:341] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a54ed96b250c4825bf13e3ba2429c7b1 (127.18.174.195:45473): Not found: Tablet not found: 8914eb0170f4424e92930f248266f962
W20260812 11:10:08.303081 16978 leader_election.cc:341] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ba784a02b8694cb7acf60b0e7c913935 (127.18.174.194:38043): Not found: Tablet not found: 8914eb0170f4424e92930f248266f962
I20260812 11:10:08.303133 16978 leader_election.cc:302] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6cdf076b5f84b5986b3e5acbbfe52dd; no voters: a54ed96b250c4825bf13e3ba2429c7b1, ba784a02b8694cb7acf60b0e7c913935
I20260812 11:10:08.303303 17749 raft_consensus.cc:2726] T 8914eb0170f4424e92930f248266f962 P e6cdf076b5f84b5986b3e5acbbfe52dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 11:10:08.726346 17750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:08.725874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:48989)
0812 11:10:08.726171 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:08.726238 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":79,"threads_started":1}
I20260812 11:10:08.903961 17752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:08.903486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:44757)
0812 11:10:08.903788 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:08.903857 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":83,"threads_started":1}
I20260812 11:10:09.097837 17755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:09.097425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:55395)
0812 11:10:09.097670 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:09.097732 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":78,"threads_started":1}
I20260812 11:10:09.727782 17757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:09.727392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.193:55467)
0812 11:10:09.727627 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:09.727686 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":77,"threads_started":1}
I20260812 11:10:09.905411 17758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:09.904898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.194:39625)
0812 11:10:09.905204 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:09.905271 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":84,"threads_started":1}
I20260812 11:10:10.086154 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 16885
I20260812 11:10:10.104044 17759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.100231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:40545 (local address 127.18.174.195:37213)
0812 11:10:10.103836 (+ 3605us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:10.103921 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.254:40545: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3486,"thread_start_us":518,"threads_started":1}
I20260812 11:10:10.110073 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 17191
I20260812 11:10:10.124684 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 17433
2026-08-12T11:10:10Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59623 ms)
[----------] 30 tests from SecurityITest (253604 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:10 dist-test-slave-lgr5 krb5kdc[17762](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:10 dist-test-slave-lgr5 krb5kdc[17762](info): set up 2 sockets
Aug 12 11:10:10 dist-test-slave-lgr5 krb5kdc[17762](info): commencing operation
krb5kdc: starting...
W20260812 11:10:11.350678 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:11 dist-test-slave-lgr5 krb5kdc[17762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533011, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:10:11.482930 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:36573
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:46589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:36573
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:11.597307 17792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:11.597610 17792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:11.597669 17792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:11.601683 17792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:11.601751 17792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:11.601778 17792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:11.601797 17792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:11.601819 17792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:11.607339 17792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:36573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:36573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:11.608542 17792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:11.609615 17792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:11.618624 17802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:11.618655 17804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:11.618852 17792 server_base.cc:1034] running on GCE node
W20260812 11:10:11.618661 17799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:11.619673 17792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:11.620959 17792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:11.622159 17792 hybrid_clock.cc:648] HybridClock initialized: now 1786533011622141 us; error 31 us; skew 500 ppm
Aug 12 11:10:11 dist-test-slave-lgr5 krb5kdc[17762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533011, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:11.625025 17792 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:10:11.625941 17792 webserver.cc:460] Webserver started at http://127.18.174.254:32951/ using document root <none> and password file <none>
I20260812 11:10:11.626487 17792 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:11.626554 17792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:11.626765 17792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:11.628909 17792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "f79c43bf0a084c6890fd09be2b468755"
format_stamp: "Formatted at 2026-08-12 11:10:11 on dist-test-slave-lgr5"
server_key: "db568ebacd0b16c7716b40b641048c9c"
server_key_iv: "d2708b2049f06c9da0dad1e0fae59f20"
server_key_version: "encryptionkey@0"
I20260812 11:10:11.629465 17792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "f79c43bf0a084c6890fd09be2b468755"
format_stamp: "Formatted at 2026-08-12 11:10:11 on dist-test-slave-lgr5"
server_key: "db568ebacd0b16c7716b40b641048c9c"
server_key_iv: "d2708b2049f06c9da0dad1e0fae59f20"
server_key_version: "encryptionkey@0"
I20260812 11:10:11.633330 17792 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260812 11:10:11.635921 17822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:11.637282 17792 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260812 11:10:11.637439 17792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "f79c43bf0a084c6890fd09be2b468755"
format_stamp: "Formatted at 2026-08-12 11:10:11 on dist-test-slave-lgr5"
server_key: "db568ebacd0b16c7716b40b641048c9c"
server_key_iv: "d2708b2049f06c9da0dad1e0fae59f20"
server_key_version: "encryptionkey@0"
I20260812 11:10:11.637555 17792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:11.657212 17792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:11.660446 17792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:11.660640 17792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:11.667757 17792 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:36573
I20260812 11:10:11.667797 17921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:36573 every 8 connection(s)
I20260812 11:10:11.668779 17792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:11.670491 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 17792
I20260812 11:10:11.670625 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:11.670915 19131 external_mini_cluster.cc:1428] Setting key f17ca490e7213ced5b416a9c6b2ea6b6
I20260812 11:10:11.672042 17925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:11.679225 17925 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755: Bootstrap starting.
Aug 12 11:10:11 dist-test-slave-lgr5 krb5kdc[17762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533011, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:11.681914 17925 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:11.682693 17925 log.cc:824] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:11.684790 17925 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755: No bootstrap required, opened a new log
I20260812 11:10:11.686452 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.672455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57118 (local address 127.18.174.254:36573)
0812 11:10:11.672890 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:11.672915 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:11.672960 (+ 45us) server_negotiation.cc:407] Connection header received
0812 11:10:11.673811 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:11.673836 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:11.674269 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:11.674671 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:11.675428 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.677002 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.677931 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.678646 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.678813 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.681464 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:11.681471 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:11.681491 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:11.681529 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:11.683309 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.683750 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.683756 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.683762 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.683896 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.684195 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.684197 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.684199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.684619 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:11.684815 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:11.685137 (+ 322us) server_negotiation.cc:299] Negotiation successful
0812 11:10:11.685479 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":127,"threads_started":1}
I20260812 11:10:11.688891 17925 raft_consensus.cc:348] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f79c43bf0a084c6890fd09be2b468755" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36573 } }
I20260812 11:10:11.689129 17925 raft_consensus.cc:374] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:11.689170 17925 raft_consensus.cc:729] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79c43bf0a084c6890fd09be2b468755, State: Initialized, Role: FOLLOWER
I20260812 11:10:11.689589 17925 consensus_queue.cc:260] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f79c43bf0a084c6890fd09be2b468755" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36573 } }
I20260812 11:10:11.689723 17925 raft_consensus.cc:388] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:11.689762 17925 raft_consensus.cc:482] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:11.689837 17925 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:11.690759 17925 raft_consensus.cc:504] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f79c43bf0a084c6890fd09be2b468755" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36573 } }
I20260812 11:10:11.691115 17925 leader_election.cc:302] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f79c43bf0a084c6890fd09be2b468755; no voters:
I20260812 11:10:11.691432 17925 leader_election.cc:288] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:11.691562 17935 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:11.691771 17935 raft_consensus.cc:686] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [term 1 LEADER]: Becoming Leader. State: Replica: f79c43bf0a084c6890fd09be2b468755, State: Running, Role: LEADER
I20260812 11:10:11.692174 17935 consensus_queue.cc:237] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f79c43bf0a084c6890fd09be2b468755" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36573 } }
I20260812 11:10:11.692790 17925 sys_catalog.cc:564] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:11.694003 17937 sys_catalog.cc:455] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f79c43bf0a084c6890fd09be2b468755. Latest consensus state: current_term: 1 leader_uuid: "f79c43bf0a084c6890fd09be2b468755" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f79c43bf0a084c6890fd09be2b468755" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36573 } } }
I20260812 11:10:11.694005 17936 sys_catalog.cc:455] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f79c43bf0a084c6890fd09be2b468755" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f79c43bf0a084c6890fd09be2b468755" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36573 } } }
I20260812 11:10:11.694159 17937 sys_catalog.cc:458] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:11.694159 17936 sys_catalog.cc:458] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:11.694567 17955 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:11.698007 17955 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:11.703857 17955 catalog_manager.cc:1347] Generated new cluster ID: 28604b69540d4178bb70bfb1211013bc
I20260812 11:10:11.703936 17955 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:11.713150 17955 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:11.714150 17955 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:11.720947 17955 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755: Generated new TSK 0
I20260812 11:10:11.721787 17955 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:10:11.759353 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36573
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:46589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:11.875948 17978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:11.876242 17978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:11.876291 17978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:11.880295 17978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:11.880357 17978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:11.880420 17978 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:10:11.885856 17978 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:11.887012 17978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:11.888113 17978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:11.898097 17986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:11.898065 17989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:11.898176 17978 server_base.cc:1034] running on GCE node
W20260812 11:10:11.898123 17994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:11.898730 17978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:11.899389 17978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:11.900554 17978 hybrid_clock.cc:648] HybridClock initialized: now 1786533011900527 us; error 38 us; skew 500 ppm
Aug 12 11:10:11 dist-test-slave-lgr5 krb5kdc[17762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533011, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:11.903225 17978 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:10:11.904172 17978 webserver.cc:460] Webserver started at http://127.18.174.193:41719/ using document root <none> and password file <none>
I20260812 11:10:11.904732 17978 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:11.904801 17978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:11.905018 17978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:11.907217 17978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "40262198a17543d8a60b74efe47b0296"
format_stamp: "Formatted at 2026-08-12 11:10:11 on dist-test-slave-lgr5"
server_key: "c2ebf8d41eddca5c13ec59d022527209"
server_key_iv: "da7a558b61b1beb06b5bb9cdcab0ec3e"
server_key_version: "encryptionkey@0"
I20260812 11:10:11.907778 17978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "40262198a17543d8a60b74efe47b0296"
format_stamp: "Formatted at 2026-08-12 11:10:11 on dist-test-slave-lgr5"
server_key: "c2ebf8d41eddca5c13ec59d022527209"
server_key_iv: "da7a558b61b1beb06b5bb9cdcab0ec3e"
server_key_version: "encryptionkey@0"
I20260812 11:10:11.911576 17978 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:10:11.914316 18008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:11.915699 17978 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:10:11.915827 17978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "40262198a17543d8a60b74efe47b0296"
format_stamp: "Formatted at 2026-08-12 11:10:11 on dist-test-slave-lgr5"
server_key: "c2ebf8d41eddca5c13ec59d022527209"
server_key_iv: "da7a558b61b1beb06b5bb9cdcab0ec3e"
server_key_version: "encryptionkey@0"
I20260812 11:10:11.915941 17978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:11.942569 17978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:11.945979 17978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:11.946170 17978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:11.946817 17978 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:11.947721 17978 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:11.947795 17978 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:11.947882 17978 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:11.947916 17978 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:11.956758 17978 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:40229
I20260812 11:10:11.956867 18233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:40229 every 8 connection(s)
I20260812 11:10:11.957736 17978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
Aug 12 11:10:11 dist-test-slave-lgr5 krb5kdc[17762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533011, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:11.967232 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 17978
I20260812 11:10:11.967360 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:11.967700 19131 external_mini_cluster.cc:1428] Setting key e8c1d2fe34f7e07639c673fa08785823
I20260812 11:10:11.971698 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.959589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:40505 (local address 127.18.174.254:36573)
0812 11:10:11.959734 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:11.959738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:11.960640 (+ 902us) server_negotiation.cc:407] Connection header received
0812 11:10:11.961943 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:11.961946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:11.962007 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:11.962082 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:11.963309 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.963850 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.965020 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.965255 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.965344 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.967896 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:11.967900 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:11.967902 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:11.967927 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:11.969447 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.970020 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.970022 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.970024 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.970091 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.970426 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.970428 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.970429 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.970620 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:11.970694 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:11.971393 (+ 699us) server_negotiation.cc:299] Negotiation successful
0812 11:10:11.971532 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:10:11.972937 18238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.959994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36573 (local address 127.18.174.193:40505)
0812 11:10:11.960487 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:11.960534 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:11.961733 (+ 1199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:11.962267 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:11.962274 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:11.962634 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:11.963162 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:11.963177 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.963978 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.963982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:11.964901 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:11.964912 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.965395 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.965400 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:11.965559 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.966111 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:11.966128 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:11.967727 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:11.969570 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:11.969577 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:11.969594 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:11.969929 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:11.970161 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:11.970163 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:11.970165 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:11.970340 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:11.970711 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:11.970717 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:11.971042 (+ 325us) client_negotiation.cc:769] Sending connection context
0812 11:10:11.971328 (+ 286us) client_negotiation.cc:240] Negotiation successful
0812 11:10:11.971681 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":123,"threads_started":1}
I20260812 11:10:11.974399 18234 heartbeater.cc:347] Connected to a master server at 127.18.174.254:36573
I20260812 11:10:11.974692 18234 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:11.975337 18234 heartbeater.cc:511] Master 127.18.174.254:36573 requested a full tablet report, sending...
I20260812 11:10:11.977247 17853 ts_manager.cc:194] Registered new tserver with Master: 40262198a17543d8a60b74efe47b0296 (127.18.174.193:40229)
I20260812 11:10:11.978914 17853 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:40505
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:10:11.999856 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36573
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:46589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:12.114955 18242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:12.115262 18242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:12.115303 18242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:12.119400 18242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:12.119467 18242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:12.119535 18242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:10:12.124940 18242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:12.126027 18242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:12.127077 18242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:12.136847 18251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:12.136932 18242 server_base.cc:1034] running on GCE node
W20260812 11:10:12.136885 18254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:12.137086 18256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:12.137501 18242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:12.138140 18242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:12.139287 18242 hybrid_clock.cc:648] HybridClock initialized: now 1786533012139257 us; error 45 us; skew 500 ppm
Aug 12 11:10:12 dist-test-slave-lgr5 krb5kdc[17762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533012, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:12.142139 18242 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:10:12.143108 18242 webserver.cc:460] Webserver started at http://127.18.174.194:43581/ using document root <none> and password file <none>
I20260812 11:10:12.143679 18242 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:12.143743 18242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:12.143937 18242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:12.146076 18242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "fe8fc0c2951a4932b8ea39a0695bdde4"
format_stamp: "Formatted at 2026-08-12 11:10:12 on dist-test-slave-lgr5"
server_key: "80d93cd111f6347484b4186551b3e8be"
server_key_iv: "cffe99bed0b3bec59367d6e2c599ad54"
server_key_version: "encryptionkey@0"
I20260812 11:10:12.146644 18242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "fe8fc0c2951a4932b8ea39a0695bdde4"
format_stamp: "Formatted at 2026-08-12 11:10:12 on dist-test-slave-lgr5"
server_key: "80d93cd111f6347484b4186551b3e8be"
server_key_iv: "cffe99bed0b3bec59367d6e2c599ad54"
server_key_version: "encryptionkey@0"
I20260812 11:10:12.150532 18242 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:10:12.153069 18271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:12.154331 18242 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:12.154469 18242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "fe8fc0c2951a4932b8ea39a0695bdde4"
format_stamp: "Formatted at 2026-08-12 11:10:12 on dist-test-slave-lgr5"
server_key: "80d93cd111f6347484b4186551b3e8be"
server_key_iv: "cffe99bed0b3bec59367d6e2c599ad54"
server_key_version: "encryptionkey@0"
I20260812 11:10:12.154575 18242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:12.176124 18242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:12.179780 18242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:12.179979 18242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:12.180687 18242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:12.181591 18242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:12.181641 18242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:12.181682 18242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:12.181708 18242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:12.190850 18242 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:34023
I20260812 11:10:12.190871 18466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:34023 every 8 connection(s)
I20260812 11:10:12.191809 18242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:12.197679 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 18242
I20260812 11:10:12.197809 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:12.198091 19131 external_mini_cluster.cc:1428] Setting key aaf316fb3bdc1e5eae9e324f7b99c294
Aug 12 11:10:12 dist-test-slave-lgr5 krb5kdc[17762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533012, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:12.206894 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.193818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:36423 (local address 127.18.174.254:36573)
0812 11:10:12.193976 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:12.193981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:12.194955 (+ 974us) server_negotiation.cc:407] Connection header received
0812 11:10:12.196324 (+ 1369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:12.196327 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:12.196396 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:12.196470 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:12.197779 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.198397 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.199743 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.199971 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.200061 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.202758 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:12.202763 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:12.202767 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:12.202797 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:12.204579 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:12.205170 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:12.205174 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:12.205176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:12.205274 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:12.205615 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:12.205619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:12.205621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:12.205893 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:12.206003 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:12.206556 (+ 553us) server_negotiation.cc:299] Negotiation successful
0812 11:10:12.206703 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 11:10:12.207738 18469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.194265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36573 (local address 127.18.174.194:36423)
0812 11:10:12.194758 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:12.194846 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:12.196118 (+ 1272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:12.196647 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:12.196654 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:12.197046 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:12.197618 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:12.197635 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.198532 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.198535 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:12.199629 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:12.199642 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.200146 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.200151 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:12.200320 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.200901 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:12.200919 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:12.202536 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:12.204733 (+ 2197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:12.204739 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:12.204755 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:12.205064 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:12.205372 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:12.205374 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:12.205376 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:12.205525 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:12.206009 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:12.206016 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:12.206305 (+ 289us) client_negotiation.cc:769] Sending connection context
0812 11:10:12.206473 (+ 168us) client_negotiation.cc:240] Negotiation successful
0812 11:10:12.206767 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":105,"threads_started":1}
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
I20260812 11:10:12.209211 18467 heartbeater.cc:347] Connected to a master server at 127.18.174.254:36573
I20260812 11:10:12.209465 18467 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:12.209980 18467 heartbeater.cc:511] Master 127.18.174.254:36573 requested a full tablet report, sending...
I20260812 11:10:12.211148 17853 ts_manager.cc:194] Registered new tserver with Master: fe8fc0c2951a4932b8ea39a0695bdde4 (127.18.174.194:34023)
I20260812 11:10:12.211764 17853 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:36423
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:10:12.226959 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36573
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:46589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:12.343927 18475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:12.344269 18475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:12.344353 18475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:12.348559 18475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:12.348644 18475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:12.348728 18475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:10:12.354532 18475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:12.355705 18475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:12.356812 18475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:12.366789 18488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:12.366789 18482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:12.366868 18475 server_base.cc:1034] running on GCE node
W20260812 11:10:12.366801 18484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:12.367458 18475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:12.368163 18475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:12.369361 18475 hybrid_clock.cc:648] HybridClock initialized: now 1786533012369339 us; error 37 us; skew 500 ppm
Aug 12 11:10:12 dist-test-slave-lgr5 krb5kdc[17762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533012, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:12.372064 18475 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:10:12.373028 18475 webserver.cc:460] Webserver started at http://127.18.174.195:33383/ using document root <none> and password file <none>
I20260812 11:10:12.373590 18475 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:12.373659 18475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:12.373864 18475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:12.375989 18475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "d9a65e8b9c78409e87e69a9c07181363"
format_stamp: "Formatted at 2026-08-12 11:10:12 on dist-test-slave-lgr5"
server_key: "3cbe7392b19243711cb98609c46472f9"
server_key_iv: "e17df056a9e3f3aabd5ce019ac26a99a"
server_key_version: "encryptionkey@0"
I20260812 11:10:12.376605 18475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "d9a65e8b9c78409e87e69a9c07181363"
format_stamp: "Formatted at 2026-08-12 11:10:12 on dist-test-slave-lgr5"
server_key: "3cbe7392b19243711cb98609c46472f9"
server_key_iv: "e17df056a9e3f3aabd5ce019ac26a99a"
server_key_version: "encryptionkey@0"
I20260812 11:10:12.380539 18475 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:10:12.383139 18497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:12.384534 18475 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:12.384663 18475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "d9a65e8b9c78409e87e69a9c07181363"
format_stamp: "Formatted at 2026-08-12 11:10:12 on dist-test-slave-lgr5"
server_key: "3cbe7392b19243711cb98609c46472f9"
server_key_iv: "e17df056a9e3f3aabd5ce019ac26a99a"
server_key_version: "encryptionkey@0"
I20260812 11:10:12.384774 18475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:12.401264 18475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:12.404507 18475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:12.404706 18475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:12.405349 18475 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:12.406237 18475 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:12.406287 18475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:12.406343 18475 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:12.406373 18475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:12.415365 18475 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:41051
I20260812 11:10:12.415393 18701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:41051 every 8 connection(s)
I20260812 11:10:12.416359 18475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:12.424702 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 18475
I20260812 11:10:12.424883 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:12.425191 19131 external_mini_cluster.cc:1428] Setting key 169459b89bb8695b3693ac23ee4e58d3
Aug 12 11:10:12 dist-test-slave-lgr5 krb5kdc[17762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533012, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:12.430045 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.418329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:37879 (local address 127.18.174.254:36573)
0812 11:10:12.418507 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:12.418511 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:12.419405 (+ 894us) server_negotiation.cc:407] Connection header received
0812 11:10:12.420852 (+ 1447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:12.420856 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:12.420913 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:12.420990 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:12.422161 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.422723 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.423845 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.424114 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.424213 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.426893 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:12.426897 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:12.426899 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:12.426929 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:12.428295 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:12.428760 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:12.428763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:12.428764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:12.428848 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:12.429132 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:12.429134 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:12.429135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:12.429308 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:12.429383 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:12.429808 (+ 425us) server_negotiation.cc:299] Negotiation successful
0812 11:10:12.429924 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260812 11:10:12.430882 18706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.418751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36573 (local address 127.18.174.195:37879)
0812 11:10:12.419216 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:12.419261 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:12.420635 (+ 1374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:12.421161 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:12.421168 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:12.421525 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:12.422021 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:12.422035 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.422854 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.422857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:12.423724 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:12.423734 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.424259 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.424263 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:12.424436 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.425055 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:12.425072 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:12.426746 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:12.428389 (+ 1643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:12.428395 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:12.428411 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:12.428667 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:12.428932 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:12.428934 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:12.428936 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:12.429066 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:12.429379 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:12.429384 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:12.429626 (+ 242us) client_negotiation.cc:769] Sending connection context
0812 11:10:12.429778 (+ 152us) client_negotiation.cc:240] Negotiation successful
0812 11:10:12.430043 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":125,"threads_started":1}
I20260812 11:10:12.431916 18704 heartbeater.cc:347] Connected to a master server at 127.18.174.254:36573
I20260812 11:10:12.432188 18704 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:12.432685 18704 heartbeater.cc:511] Master 127.18.174.254:36573 requested a full tablet report, sending...
I20260812 11:10:12.433738 17853 ts_manager.cc:194] Registered new tserver with Master: d9a65e8b9c78409e87e69a9c07181363 (127.18.174.195:41051)
I20260812 11:10:12.434273 17853 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:37879
I20260812 11:10:12.439257 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:10:12.448961 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.441347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57130 (local address 127.18.174.254:36573)
0812 11:10:12.441468 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:12.441472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:12.441700 (+ 228us) server_negotiation.cc:407] Connection header received
0812 11:10:12.441794 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:12.441796 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:12.441839 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:12.441912 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:12.442802 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.443345 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.444271 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.444517 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.444594 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.445958 (+ 1364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:12.445961 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:12.445964 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:12.445993 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:12.447382 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:12.447829 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:12.447832 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:12.447834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:12.447922 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:12.448170 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:12.448172 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:12.448174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:12.448439 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:12.448547 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:12.448733 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 11:10:12.448836 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:10:12.451972 17853 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:10:12.455093 17853 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:12.470176 18720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.464490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:40229 (local address 127.0.0.1:33968)
0812 11:10:12.465407 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:12.465419 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:12.465506 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:12.466118 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:12.466121 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:12.466154 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:12.466289 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:12.466295 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.467615 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.467618 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:12.468788 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:12.468799 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.469623 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.469626 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:12.469732 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.469771 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 11:10:12.469888 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 11:10:12.470010 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":862,"mutex_wait_us":78,"spinlock_wait_cycles":4736,"thread_start_us":100,"threads_started":1}
I20260812 11:10:12.470331 18725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.464925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34800 (local address 127.18.174.195:41051)
0812 11:10:12.465466 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:12.465479 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:12.465504 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:10:12.465582 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:12.465588 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:12.465806 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:12.465977 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:12.466244 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.467429 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.468955 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.469801 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.469925 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.470051 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:12.470107 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 11:10:12.470189 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":103,"threads_started":1}
I20260812 11:10:12.470489 18723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.464742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33968 (local address 127.18.174.193:40229)
0812 11:10:12.465086 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:12.465102 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:12.465591 (+ 489us) server_negotiation.cc:407] Connection header received
0812 11:10:12.465663 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:12.465667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:12.465823 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:12.465958 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:12.466411 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.467510 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.468896 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.469509 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.469623 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.469771 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:12.470247 (+ 476us) server_negotiation.cc:299] Negotiation successful
0812 11:10:12.470353 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":138,"threads_started":1}
I20260812 11:10:12.470355 18718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.464196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:41051 (local address 127.0.0.1:34800)
0812 11:10:12.465152 (+ 956us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:12.465163 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:12.465231 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:12.465969 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:12.465975 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:12.466000 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:12.466131 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:12.466139 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.467570 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.467573 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:12.468835 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:12.468842 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.469919 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.469922 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:12.470003 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.470023 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:10:12.470080 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 11:10:12.470133 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":900,"mutex_wait_us":72,"thread_start_us":98,"threads_started":1}
I20260812 11:10:12.471004 18722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.464045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:34023 (local address 127.0.0.1:46660)
0812 11:10:12.464994 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:12.465049 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:12.465187 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:12.466118 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:12.466121 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:12.466158 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:12.466289 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:12.466295 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.467328 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.467331 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:12.468803 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:12.468816 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.470660 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.470665 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:12.470755 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.470777 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 11:10:12.470849 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 11:10:12.470910 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":762,"mutex_wait_us":112,"spinlock_wait_cycles":5376,"thread_start_us":86,"threads_started":1}
I20260812 11:10:12.471138 18721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.464193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46660 (local address 127.18.174.194:34023)
0812 11:10:12.465472 (+ 1279us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:12.465484 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:12.465506 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:10:12.465586 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:12.465591 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:12.465798 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:12.465958 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:12.466442 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.467189 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.468955 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.469800 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.469938 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.470051 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:12.470906 (+ 855us) server_negotiation.cc:299] Negotiation successful
0812 11:10:12.471008 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1182,"thread_start_us":142,"threads_started":1}
I20260812 11:10:12.473829 18353 tablet_service.cc:1467] Processing CreateTablet for tablet 9895d58efbc14041ab4efd9807c31545 (DEFAULT_TABLE table=test-table [id=5338b88b532b4a91ba189627238ffbb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:12.473879 18111 tablet_service.cc:1467] Processing CreateTablet for tablet 9895d58efbc14041ab4efd9807c31545 (DEFAULT_TABLE table=test-table [id=5338b88b532b4a91ba189627238ffbb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:12.473879 18589 tablet_service.cc:1467] Processing CreateTablet for tablet 9895d58efbc14041ab4efd9807c31545 (DEFAULT_TABLE table=test-table [id=5338b88b532b4a91ba189627238ffbb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:12.474913 18353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9895d58efbc14041ab4efd9807c31545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:12.474923 18589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9895d58efbc14041ab4efd9807c31545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:12.474924 18111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9895d58efbc14041ab4efd9807c31545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:12.481843 18726 tablet_bootstrap.cc:492] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4: Bootstrap starting.
I20260812 11:10:12.483088 18727 tablet_bootstrap.cc:492] T 9895d58efbc14041ab4efd9807c31545 P 40262198a17543d8a60b74efe47b0296: Bootstrap starting.
I20260812 11:10:12.484263 18726 tablet_bootstrap.cc:654] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:12.484462 18729 tablet_bootstrap.cc:492] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363: Bootstrap starting.
I20260812 11:10:12.485227 18727 tablet_bootstrap.cc:654] T 9895d58efbc14041ab4efd9807c31545 P 40262198a17543d8a60b74efe47b0296: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:12.485643 18726 log.cc:824] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:12.486240 18727 log.cc:824] T 9895d58efbc14041ab4efd9807c31545 P 40262198a17543d8a60b74efe47b0296: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:12.486706 18729 tablet_bootstrap.cc:654] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:12.487753 18726 tablet_bootstrap.cc:492] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4: No bootstrap required, opened a new log
I20260812 11:10:12.487926 18729 log.cc:824] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:12.487969 18726 ts_tablet_manager.cc:1397] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260812 11:10:12.488463 18727 tablet_bootstrap.cc:492] T 9895d58efbc14041ab4efd9807c31545 P 40262198a17543d8a60b74efe47b0296: No bootstrap required, opened a new log
I20260812 11:10:12.488677 18727 ts_tablet_manager.cc:1397] T 9895d58efbc14041ab4efd9807c31545 P 40262198a17543d8a60b74efe47b0296: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:10:12.490445 18729 tablet_bootstrap.cc:492] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363: No bootstrap required, opened a new log
I20260812 11:10:12.490724 18729 ts_tablet_manager.cc:1397] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:10:12.491297 18726 raft_consensus.cc:348] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8fc0c2951a4932b8ea39a0695bdde4" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 34023 } } peers { permanent_uuid: "d9a65e8b9c78409e87e69a9c07181363" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 41051 } } peers { permanent_uuid: "40262198a17543d8a60b74efe47b0296" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 40229 } }
I20260812 11:10:12.491761 18726 raft_consensus.cc:374] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:12.491886 18726 raft_consensus.cc:729] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8fc0c2951a4932b8ea39a0695bdde4, State: Initialized, Role: FOLLOWER
I20260812 11:10:12.492409 18726 consensus_queue.cc:260] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8fc0c2951a4932b8ea39a0695bdde4" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 34023 } } peers { permanent_uuid: "d9a65e8b9c78409e87e69a9c07181363" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 41051 } } peers { permanent_uuid: "40262198a17543d8a60b74efe47b0296" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 40229 } }
I20260812 11:10:12.493223 18467 heartbeater.cc:503] Master 127.18.174.254:36573 was elected leader, sending a full tablet report...
I20260812 11:10:12.493791 18727 raft_consensus.cc:348] T 9895d58efbc14041ab4efd9807c31545 P 40262198a17543d8a60b74efe47b0296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8fc0c2951a4932b8ea39a0695bdde4" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 34023 } } peers { permanent_uuid: "d9a65e8b9c78409e87e69a9c07181363" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 41051 } } peers { permanent_uuid: "40262198a17543d8a60b74efe47b0296" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 40229 } }
I20260812 11:10:12.494140 18727 raft_consensus.cc:374] T 9895d58efbc14041ab4efd9807c31545 P 40262198a17543d8a60b74efe47b0296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:12.494246 18727 raft_consensus.cc:729] T 9895d58efbc14041ab4efd9807c31545 P 40262198a17543d8a60b74efe47b0296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40262198a17543d8a60b74efe47b0296, State: Initialized, Role: FOLLOWER
I20260812 11:10:12.494676 18726 ts_tablet_manager.cc:1428] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 11:10:12.494814 18727 consensus_queue.cc:260] T 9895d58efbc14041ab4efd9807c31545 P 40262198a17543d8a60b74efe47b0296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8fc0c2951a4932b8ea39a0695bdde4" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 34023 } } peers { permanent_uuid: "d9a65e8b9c78409e87e69a9c07181363" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 41051 } } peers { permanent_uuid: "40262198a17543d8a60b74efe47b0296" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 40229 } }
I20260812 11:10:12.495021 18729 raft_consensus.cc:348] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8fc0c2951a4932b8ea39a0695bdde4" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 34023 } } peers { permanent_uuid: "d9a65e8b9c78409e87e69a9c07181363" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 41051 } } peers { permanent_uuid: "40262198a17543d8a60b74efe47b0296" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 40229 } }
I20260812 11:10:12.495368 18729 raft_consensus.cc:374] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:12.495481 18729 raft_consensus.cc:729] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a65e8b9c78409e87e69a9c07181363, State: Initialized, Role: FOLLOWER
I20260812 11:10:12.495659 18234 heartbeater.cc:503] Master 127.18.174.254:36573 was elected leader, sending a full tablet report...
I20260812 11:10:12.496102 18727 ts_tablet_manager.cc:1428] T 9895d58efbc14041ab4efd9807c31545 P 40262198a17543d8a60b74efe47b0296: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 11:10:12.495999 18729 consensus_queue.cc:260] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8fc0c2951a4932b8ea39a0695bdde4" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 34023 } } peers { permanent_uuid: "d9a65e8b9c78409e87e69a9c07181363" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 41051 } } peers { permanent_uuid: "40262198a17543d8a60b74efe47b0296" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 40229 } }
I20260812 11:10:12.496989 18729 ts_tablet_manager.cc:1428] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:10:12.497386 18704 heartbeater.cc:503] Master 127.18.174.254:36573 was elected leader, sending a full tablet report...
I20260812 11:10:12.533746 18736 raft_consensus.cc:482] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:12.533960 18736 raft_consensus.cc:504] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8fc0c2951a4932b8ea39a0695bdde4" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 34023 } } peers { permanent_uuid: "d9a65e8b9c78409e87e69a9c07181363" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 41051 } } peers { permanent_uuid: "40262198a17543d8a60b74efe47b0296" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 40229 } }
I20260812 11:10:12.535197 18736 leader_election.cc:288] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a65e8b9c78409e87e69a9c07181363 (127.18.174.195:41051), 40262198a17543d8a60b74efe47b0296 (127.18.174.193:40229)
I20260812 11:10:12.539034 18723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.535598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:43757 (local address 127.18.174.193:40229)
0812 11:10:12.535718 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:12.535722 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:12.535973 (+ 251us) server_negotiation.cc:407] Connection header received
0812 11:10:12.536100 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:12.536103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:12.536159 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:12.536236 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:12.536536 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.537030 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.538117 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.538515 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.538628 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.538679 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:12.538834 (+ 155us) server_negotiation.cc:299] Negotiation successful
0812 11:10:12.538903 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:10:12.539033 18725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.535555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:49363 (local address 127.18.174.195:41051)
0812 11:10:12.535672 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:12.535677 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:12.535845 (+ 168us) server_negotiation.cc:407] Connection header received
0812 11:10:12.535981 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:12.535984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:12.536036 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:12.536138 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:12.536426 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.536964 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.538053 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.538473 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.538577 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.538633 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:12.538813 (+ 180us) server_negotiation.cc:299] Negotiation successful
0812 11:10:12.538895 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 11:10:12.539039 18469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.535407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:41051 (local address 127.18.174.194:49363)
0812 11:10:12.535765 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:12.535779 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:12.535872 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:12.536146 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:12.536149 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:12.536165 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:12.536315 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:12.536323 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.537072 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.537075 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:12.537908 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:12.537919 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.538588 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.538592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:12.538693 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.538717 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:10:12.538778 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 11:10:12.538899 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":6}
I20260812 11:10:12.539057 18740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.535508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:40229 (local address 127.18.174.194:43757)
0812 11:10:12.535860 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:12.535883 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:12.535992 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:12.536258 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:12.536260 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:12.536276 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:12.536424 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:12.536431 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.537169 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.537171 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:12.537997 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:12.538009 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.538631 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.538634 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:12.538720 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.538737 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 11:10:12.538809 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 11:10:12.538904 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":41,"thread_start_us":137,"threads_started":1}
I20260812 11:10:12.539810 18146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9895d58efbc14041ab4efd9807c31545" candidate_uuid: "fe8fc0c2951a4932b8ea39a0695bdde4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40262198a17543d8a60b74efe47b0296" is_pre_election: true
I20260812 11:10:12.539803 18621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9895d58efbc14041ab4efd9807c31545" candidate_uuid: "fe8fc0c2951a4932b8ea39a0695bdde4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a65e8b9c78409e87e69a9c07181363" is_pre_election: true
I20260812 11:10:12.540189 18621 raft_consensus.cc:2454] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe8fc0c2951a4932b8ea39a0695bdde4 in term 0.
I20260812 11:10:12.540189 18146 raft_consensus.cc:2454] T 9895d58efbc14041ab4efd9807c31545 P 40262198a17543d8a60b74efe47b0296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe8fc0c2951a4932b8ea39a0695bdde4 in term 0.
I20260812 11:10:12.540716 18277 leader_election.cc:302] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40262198a17543d8a60b74efe47b0296, fe8fc0c2951a4932b8ea39a0695bdde4; no voters:
I20260812 11:10:12.541072 18736 raft_consensus.cc:2781] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:12.541188 18736 raft_consensus.cc:482] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:12.541242 18736 raft_consensus.cc:3037] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:12.542404 18736 raft_consensus.cc:504] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8fc0c2951a4932b8ea39a0695bdde4" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 34023 } } peers { permanent_uuid: "d9a65e8b9c78409e87e69a9c07181363" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 41051 } } peers { permanent_uuid: "40262198a17543d8a60b74efe47b0296" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 40229 } }
I20260812 11:10:12.542778 18736 leader_election.cc:288] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [CANDIDATE]: Term 1 election: Requested vote from peers d9a65e8b9c78409e87e69a9c07181363 (127.18.174.195:41051), 40262198a17543d8a60b74efe47b0296 (127.18.174.193:40229)
I20260812 11:10:12.543188 18621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9895d58efbc14041ab4efd9807c31545" candidate_uuid: "fe8fc0c2951a4932b8ea39a0695bdde4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a65e8b9c78409e87e69a9c07181363"
I20260812 11:10:12.543232 18146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9895d58efbc14041ab4efd9807c31545" candidate_uuid: "fe8fc0c2951a4932b8ea39a0695bdde4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40262198a17543d8a60b74efe47b0296"
I20260812 11:10:12.543359 18621 raft_consensus.cc:3037] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:12.543354 18146 raft_consensus.cc:3037] T 9895d58efbc14041ab4efd9807c31545 P 40262198a17543d8a60b74efe47b0296 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:12.544523 18621 raft_consensus.cc:2454] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe8fc0c2951a4932b8ea39a0695bdde4 in term 1.
I20260812 11:10:12.544533 18146 raft_consensus.cc:2454] T 9895d58efbc14041ab4efd9807c31545 P 40262198a17543d8a60b74efe47b0296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe8fc0c2951a4932b8ea39a0695bdde4 in term 1.
I20260812 11:10:12.544842 18277 leader_election.cc:302] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40262198a17543d8a60b74efe47b0296, fe8fc0c2951a4932b8ea39a0695bdde4; no voters:
I20260812 11:10:12.545010 18736 raft_consensus.cc:2781] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:12.545238 18736 raft_consensus.cc:686] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [term 1 LEADER]: Becoming Leader. State: Replica: fe8fc0c2951a4932b8ea39a0695bdde4, State: Running, Role: LEADER
I20260812 11:10:12.545583 18736 consensus_queue.cc:237] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8fc0c2951a4932b8ea39a0695bdde4" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 34023 } } peers { permanent_uuid: "d9a65e8b9c78409e87e69a9c07181363" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 41051 } } peers { permanent_uuid: "40262198a17543d8a60b74efe47b0296" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 40229 } }
I20260812 11:10:12.549068 17852 catalog_manager.cc:5495] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe8fc0c2951a4932b8ea39a0695bdde4 (127.18.174.194). New cstate: current_term: 1 leader_uuid: "fe8fc0c2951a4932b8ea39a0695bdde4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8fc0c2951a4932b8ea39a0695bdde4" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 34023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9a65e8b9c78409e87e69a9c07181363" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 41051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40262198a17543d8a60b74efe47b0296" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 40229 } health_report { overall_health: UNKNOWN } } }
I20260812 11:10:12.574944 18721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.571313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46676 (local address 127.18.174.194:34023)
0812 11:10:12.571451 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:12.571455 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:12.571471 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:10:12.571616 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:12.571618 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:12.571681 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:12.571787 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:12.571969 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.572523 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.573401 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.573630 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.573717 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.574048 (+ 331us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:12.574520 (+ 472us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:12.574628 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:12.574665 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 11:10:12.574726 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:10:12.581269 18146 raft_consensus.cc:1261] T 9895d58efbc14041ab4efd9807c31545 P 40262198a17543d8a60b74efe47b0296 [term 1 FOLLOWER]: Refusing update from remote peer fe8fc0c2951a4932b8ea39a0695bdde4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:12.581275 18621 raft_consensus.cc:1261] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363 [term 1 FOLLOWER]: Refusing update from remote peer fe8fc0c2951a4932b8ea39a0695bdde4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:12.582031 18742 consensus_queue.cc:1035] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40262198a17543d8a60b74efe47b0296" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 40229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:12.582240 18736 consensus_queue.cc:1035] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a65e8b9c78409e87e69a9c07181363" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 41051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:12.592695 18748 mvcc.cc:205] Tried to move back new op lower bound from 7317639219524734976 to 7317639219389726720. Current Snapshot: MvccSnapshot[applied={T|T < 7317639219524734976}]
I20260812 11:10:12.601758 17853 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:12.601950 17853 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:12.604575 17853 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f79c43bf0a084c6890fd09be2b468755: Sending DeleteTablet for 3 replicas of tablet 9895d58efbc14041ab4efd9807c31545
I20260812 11:10:12.605417 18353 tablet_service.cc:1514] Processing DeleteTablet for tablet 9895d58efbc14041ab4efd9807c31545 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:12 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:46660
I20260812 11:10:12.605654 18111 tablet_service.cc:1514] Processing DeleteTablet for tablet 9895d58efbc14041ab4efd9807c31545 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:12 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:33968
I20260812 11:10:12.606074 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 17978
I20260812 11:10:12.606166 18589 tablet_service.cc:1514] Processing DeleteTablet for tablet 9895d58efbc14041ab4efd9807c31545 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:12 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:34800
I20260812 11:10:12.613444 18773 tablet_replica.cc:330] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4: stopping tablet replica
I20260812 11:10:12.613982 18773 raft_consensus.cc:2229] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:10:12.614595 18773 raft_consensus.cc:2258] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:12.622876 18773 ts_tablet_manager.cc:1905] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:12.626477 18773 ts_tablet_manager.cc:1918] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:12.626662 18780 tablet_replica.cc:330] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363: stopping tablet replica
I20260812 11:10:12.626689 18773 log.cc:1196] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/9895d58efbc14041ab4efd9807c31545
I20260812 11:10:12.627095 18773 ts_tablet_manager.cc:1939] T 9895d58efbc14041ab4efd9807c31545 P fe8fc0c2951a4932b8ea39a0695bdde4: Deleting consensus metadata
I20260812 11:10:12.627321 18780 raft_consensus.cc:2229] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:12.627780 18780 raft_consensus.cc:2258] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:12.628738 17826 catalog_manager.cc:4841] TS fe8fc0c2951a4932b8ea39a0695bdde4 (127.18.174.194:34023): tablet 9895d58efbc14041ab4efd9807c31545 (table test-table [id=5338b88b532b4a91ba189627238ffbb9]) successfully deleted
I20260812 11:10:12.629609 18780 ts_tablet_manager.cc:1905] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:12.631873 18780 ts_tablet_manager.cc:1918] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:12.631976 18780 log.cc:1196] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/9895d58efbc14041ab4efd9807c31545
I20260812 11:10:12.632305 18780 ts_tablet_manager.cc:1939] T 9895d58efbc14041ab4efd9807c31545 P d9a65e8b9c78409e87e69a9c07181363: Deleting consensus metadata
I20260812 11:10:12.633626 17825 catalog_manager.cc:4841] TS d9a65e8b9c78409e87e69a9c07181363 (127.18.174.195:41051): tablet 9895d58efbc14041ab4efd9807c31545 (table test-table [id=5338b88b532b4a91ba189627238ffbb9]) successfully deleted
W20260812 11:10:12.634146 17827 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:40229 (error 108)
I20260812 11:10:12.634461 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 18242
I20260812 11:10:12.638458 18722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.638123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:40229 (local address 127.0.0.1:33976)
0812 11:10:12.638270 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:12.638355 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:40229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 11:10:12.638681 17827 catalog_manager.cc:4584] TS 40262198a17543d8a60b74efe47b0296 (127.18.174.193:40229): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9895d58efbc14041ab4efd9807c31545: Network error: Client connection negotiation failed: client connection to 127.18.174.193:40229: connect: Connection refused (error 111)
I20260812 11:10:12.644913 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 18475
I20260812 11:10:12.692500 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 17792
I20260812 11:10:12.692679 18722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.692361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:40229 (local address 127.0.0.1:33980)
0812 11:10:12.692527 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:12.692585 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:40229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
2026-08-12T11:10:12Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2562 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T11:10:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:12Z Disabled control of system clock
I20260812 11:10:12.731767 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:44887
--webserver_interface=127.18.174.254
--webserver_port=0
--builtin_ntp_servers=127.18.174.212:43605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:44887
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:10:12.848119 18794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:12.848421 18794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:12.848475 18794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:12.852525 18794 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:12.852591 18794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:12.852612 18794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:12.852633 18794 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:12.852654 18794 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:12.857529 18794 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:43605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:44887
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:44887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:12.858721 18794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:12.860225 18794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:10:12.869108 18794 server_base.cc:1034] running on GCE node
W20260812 11:10:12.869072 18804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:12.869297 18805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:12.869082 18809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:12.869941 18794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:12.871129 18794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:12.872298 18794 hybrid_clock.cc:648] HybridClock initialized: now 1786533012872263 us; error 46 us; skew 500 ppm
I20260812 11:10:12.880179 18794 webserver.cc:460] Webserver started at http://127.18.174.254:45191/ using document root <none> and password file <none>
I20260812 11:10:12.880877 18794 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:12.880980 18794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:12.881214 18794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:12.883555 18794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "e1b0905ef0e24305bb601400faf1d5b4"
format_stamp: "Formatted at 2026-08-12 11:10:12 on dist-test-slave-lgr5"
server_key: "25ae204aff40f9c07517a153260e5771"
server_key_iv: "4377be51c324178ee96dc50e4b7cbce6"
server_key_version: "encryptionkey@0"
I20260812 11:10:12.884253 18794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "e1b0905ef0e24305bb601400faf1d5b4"
format_stamp: "Formatted at 2026-08-12 11:10:12 on dist-test-slave-lgr5"
server_key: "25ae204aff40f9c07517a153260e5771"
server_key_iv: "4377be51c324178ee96dc50e4b7cbce6"
server_key_version: "encryptionkey@0"
I20260812 11:10:12.888484 18794 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:10:12.891151 18819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:12.892558 18794 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:12.892679 18794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "e1b0905ef0e24305bb601400faf1d5b4"
format_stamp: "Formatted at 2026-08-12 11:10:12 on dist-test-slave-lgr5"
server_key: "25ae204aff40f9c07517a153260e5771"
server_key_iv: "4377be51c324178ee96dc50e4b7cbce6"
server_key_version: "encryptionkey@0"
I20260812 11:10:12.892799 18794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:12.904055 18794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:12.904809 18794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:12.904995 18794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:12.911855 18794 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:44887
I20260812 11:10:12.911865 18909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:44887 every 8 connection(s)
I20260812 11:10:12.912853 18794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:12.916165 18912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:12.918710 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 18794
I20260812 11:10:12.918866 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:12.919211 19131 external_mini_cluster.cc:1428] Setting key 0f840a60d56ad3ea5f3d8b790c247d5b
I20260812 11:10:12.922952 18912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4: Bootstrap starting.
I20260812 11:10:12.925379 18912 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:12.926172 18912 log.cc:824] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:12.928476 18912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4: No bootstrap required, opened a new log
I20260812 11:10:12.928841 18919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:12.920775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33244 (local address 127.18.174.254:44887)
0812 11:10:12.921494 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:12.921511 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:12.921547 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:10:12.922200 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:12.922218 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:12.922634 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:12.922951 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:12.923401 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.924446 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.925322 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:12.925856 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:12.926014 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:12.926929 (+ 915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:12.926936 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:12.926956 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:12.927363 (+ 407us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:12.927450 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:12.927473 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:12.927553 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:12.927742 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 11:10:12.928007 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":152,"threads_started":1}
I20260812 11:10:12.932458 18912 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b0905ef0e24305bb601400faf1d5b4" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44887 } }
I20260812 11:10:12.932705 18912 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:12.932765 18912 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b0905ef0e24305bb601400faf1d5b4, State: Initialized, Role: FOLLOWER
I20260812 11:10:12.933182 18912 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b0905ef0e24305bb601400faf1d5b4" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44887 } }
I20260812 11:10:12.933321 18912 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:12.933389 18912 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:12.933493 18912 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:12.934449 18912 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b0905ef0e24305bb601400faf1d5b4" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44887 } }
I20260812 11:10:12.934816 18912 leader_election.cc:302] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1b0905ef0e24305bb601400faf1d5b4; no voters:
I20260812 11:10:12.935199 18912 leader_election.cc:288] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:12.935317 18922 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:12.935527 18922 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [term 1 LEADER]: Becoming Leader. State: Replica: e1b0905ef0e24305bb601400faf1d5b4, State: Running, Role: LEADER
I20260812 11:10:12.935835 18922 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b0905ef0e24305bb601400faf1d5b4" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44887 } }
I20260812 11:10:12.936466 18912 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:12.937520 18926 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1b0905ef0e24305bb601400faf1d5b4. Latest consensus state: current_term: 1 leader_uuid: "e1b0905ef0e24305bb601400faf1d5b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b0905ef0e24305bb601400faf1d5b4" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44887 } } }
I20260812 11:10:12.937674 18926 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:12.938050 18924 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1b0905ef0e24305bb601400faf1d5b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1b0905ef0e24305bb601400faf1d5b4" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44887 } } }
I20260812 11:10:12.938064 18937 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:12.938724 18924 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:12.941625 18937 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:12.947347 18937 catalog_manager.cc:1347] Generated new cluster ID: 86caa9d80dda4ccc9b3c7dbc5f690bab
I20260812 11:10:12.947444 18937 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:12.965364 18937 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:12.966694 18937 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:12.974843 18937 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4: Generated new TSK 0
I20260812 11:10:12.975679 18937 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:12.986285 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44887
--builtin_ntp_servers=127.18.174.212:43605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:10:13.117403 18956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:13.117707 18956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:13.117749 18956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:13.121732 18956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:13.121790 18956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:13.121850 18956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:10:13.126650 18956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:43605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44887
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:13.127791 18956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:13.129263 18956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:13.139487 18968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:13.139441 18964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:13.139441 18971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:13.139676 18956 server_base.cc:1034] running on GCE node
I20260812 11:10:13.140343 18956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:13.141057 18956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:13.142246 18956 hybrid_clock.cc:648] HybridClock initialized: now 1786533013142222 us; error 41 us; skew 500 ppm
I20260812 11:10:13.144397 18956 webserver.cc:460] Webserver started at http://127.18.174.193:37995/ using document root <none> and password file <none>
I20260812 11:10:13.144997 18956 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:13.145069 18956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:13.145268 18956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:13.147387 18956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "afcee80744334311aa92463fc9517ef6"
format_stamp: "Formatted at 2026-08-12 11:10:13 on dist-test-slave-lgr5"
server_key: "67e2567227caca8ddae2998dea27335a"
server_key_iv: "466c4cb0dbb5c66680c4feb0b1dbb0f5"
server_key_version: "encryptionkey@0"
I20260812 11:10:13.147944 18956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "afcee80744334311aa92463fc9517ef6"
format_stamp: "Formatted at 2026-08-12 11:10:13 on dist-test-slave-lgr5"
server_key: "67e2567227caca8ddae2998dea27335a"
server_key_iv: "466c4cb0dbb5c66680c4feb0b1dbb0f5"
server_key_version: "encryptionkey@0"
I20260812 11:10:13.151674 18956 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:10:13.154222 18983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:13.155601 18956 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:10:13.155718 18956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "afcee80744334311aa92463fc9517ef6"
format_stamp: "Formatted at 2026-08-12 11:10:13 on dist-test-slave-lgr5"
server_key: "67e2567227caca8ddae2998dea27335a"
server_key_iv: "466c4cb0dbb5c66680c4feb0b1dbb0f5"
server_key_version: "encryptionkey@0"
I20260812 11:10:13.155821 18956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:13.186096 18956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:13.186911 18956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:13.187125 18956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:13.187789 18956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:13.188832 18956 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:13.188882 18956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:13.188938 18956 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:13.188966 18956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:13.197692 18956 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:36737
I20260812 11:10:13.197727 19218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:36737 every 8 connection(s)
I20260812 11:10:13.198657 18956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:13.205104 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 18956
I20260812 11:10:13.205251 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:13.205544 19131 external_mini_cluster.cc:1428] Setting key 4dc87c580de0e0a7f0c8b3a7c00d1970
I20260812 11:10:13.207726 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44887
--builtin_ntp_servers=127.18.174.212:43605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:10:13.208819 18919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.200619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:46131 (local address 127.18.174.254:44887)
0812 11:10:13.200749 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:13.200752 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:13.201865 (+ 1113us) server_negotiation.cc:407] Connection header received
0812 11:10:13.203332 (+ 1467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:13.203336 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:13.203411 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:13.203489 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:13.204508 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.205167 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.206572 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.206847 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.206979 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.208315 (+ 1336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:13.208318 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:13.208320 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:13.208333 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:13.208354 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:13.208361 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:13.208451 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:13.208607 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 11:10:13.208674 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:10:13.209800 19221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.201013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44887 (local address 127.18.174.193:46131)
0812 11:10:13.201711 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:13.201754 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:13.203101 (+ 1347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:13.203687 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:13.203694 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:13.203785 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:13.204359 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.204378 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.205388 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.205392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.206455 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.206468 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.207046 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.207051 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.207317 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.208004 (+ 687us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:13.208006 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:13.208053 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:13.208165 (+ 112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:13.208462 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:13.208473 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:13.208480 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 11:10:13.208601 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 11:10:13.209009 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":130,"threads_started":1}
I20260812 11:10:13.211056 19219 heartbeater.cc:347] Connected to a master server at 127.18.174.254:44887
I20260812 11:10:13.211335 19219 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:13.212020 19219 heartbeater.cc:511] Master 127.18.174.254:44887 requested a full tablet report, sending...
I20260812 11:10:13.213721 18837 ts_manager.cc:194] Registered new tserver with Master: afcee80744334311aa92463fc9517ef6 (127.18.174.193:36737)
I20260812 11:10:13.214912 18837 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.174.193:46131
W20260812 11:10:13.323655 19222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:13.323935 19222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:13.323972 19222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:13.328037 19222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:13.328152 19222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:13.328214 19222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:10:13.333134 19222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:43605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44887
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:13.334357 19222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:13.335876 19222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:13.346235 19236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:13.346236 19229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:13.346235 19230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:13.346618 19222 server_base.cc:1034] running on GCE node
I20260812 11:10:13.347110 19222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:13.347798 19222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:13.348985 19222 hybrid_clock.cc:648] HybridClock initialized: now 1786533013348942 us; error 52 us; skew 500 ppm
I20260812 11:10:13.351001 19222 webserver.cc:460] Webserver started at http://127.18.174.194:41789/ using document root <none> and password file <none>
I20260812 11:10:13.351601 19222 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:13.351672 19222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:13.351888 19222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:13.354169 19222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "5b940ab725054c7f96eb4423371b9b12"
format_stamp: "Formatted at 2026-08-12 11:10:13 on dist-test-slave-lgr5"
server_key: "9b35c4d951c25714b2ed8587d1cb5ef0"
server_key_iv: "132812167da6856767224af87e8e9d52"
server_key_version: "encryptionkey@0"
I20260812 11:10:13.354831 19222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "5b940ab725054c7f96eb4423371b9b12"
format_stamp: "Formatted at 2026-08-12 11:10:13 on dist-test-slave-lgr5"
server_key: "9b35c4d951c25714b2ed8587d1cb5ef0"
server_key_iv: "132812167da6856767224af87e8e9d52"
server_key_version: "encryptionkey@0"
I20260812 11:10:13.359926 19222 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:10:13.363211 19246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:13.365042 19222 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:13.365181 19222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "5b940ab725054c7f96eb4423371b9b12"
format_stamp: "Formatted at 2026-08-12 11:10:13 on dist-test-slave-lgr5"
server_key: "9b35c4d951c25714b2ed8587d1cb5ef0"
server_key_iv: "132812167da6856767224af87e8e9d52"
server_key_version: "encryptionkey@0"
I20260812 11:10:13.365322 19222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:13.404333 19222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:13.405112 19222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:13.405298 19222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:13.405923 19222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:13.406909 19222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:13.406960 19222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:13.407014 19222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:13.407039 19222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:13.415364 19222 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:33173
I20260812 11:10:13.415413 19457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:33173 every 8 connection(s)
I20260812 11:10:13.416329 19222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:13.425709 18919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.418189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:57629 (local address 127.18.174.254:44887)
0812 11:10:13.418311 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:13.418315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:13.419376 (+ 1061us) server_negotiation.cc:407] Connection header received
0812 11:10:13.420861 (+ 1485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:13.420873 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:13.420936 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:13.421008 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:13.421991 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.422524 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.423713 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.423941 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.424033 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.425181 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:13.425184 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:13.425186 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:13.425199 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:13.425219 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:13.425227 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:13.425288 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:13.425479 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 11:10:13.425549 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:10:13.426043 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 19222
I20260812 11:10:13.426175 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:13.426456 19131 external_mini_cluster.cc:1428] Setting key b11feef37be87d3e98c7afadfbe174da
I20260812 11:10:13.426657 19462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.418561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44887 (local address 127.18.174.194:57629)
0812 11:10:13.419226 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:13.419266 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:13.420640 (+ 1374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:13.421208 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:13.421215 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:13.421303 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:13.421847 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.421863 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.422648 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.422651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.423586 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.423597 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.424119 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.424124 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.424290 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.424915 (+ 625us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:13.424917 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:13.424960 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:13.425030 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:13.425310 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:13.425319 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:13.425323 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:10:13.425469 (+ 146us) client_negotiation.cc:240] Negotiation successful
0812 11:10:13.425769 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":114,"threads_started":1}
I20260812 11:10:13.427937 19459 heartbeater.cc:347] Connected to a master server at 127.18.174.254:44887
I20260812 11:10:13.428221 19459 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:13.428606 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44887
--builtin_ntp_servers=127.18.174.212:43605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:10:13.428804 19459 heartbeater.cc:511] Master 127.18.174.254:44887 requested a full tablet report, sending...
I20260812 11:10:13.429909 18837 ts_manager.cc:194] Registered new tserver with Master: 5b940ab725054c7f96eb4423371b9b12 (127.18.174.194:33173)
I20260812 11:10:13.430491 18837 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.174.194:57629
W20260812 11:10:13.548671 19464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:13.548967 19464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:13.549006 19464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:13.553041 19464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:13.553102 19464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:13.553156 19464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:10:13.558127 19464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:43605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:44887
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:13.559365 19464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:13.560922 19464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:13.570874 19481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:13.570863 19473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:13.570863 19476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:13.571174 19464 server_base.cc:1034] running on GCE node
I20260812 11:10:13.571596 19464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:13.572337 19464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:13.573496 19464 hybrid_clock.cc:648] HybridClock initialized: now 1786533013573475 us; error 33 us; skew 500 ppm
I20260812 11:10:13.575434 19464 webserver.cc:460] Webserver started at http://127.18.174.195:46535/ using document root <none> and password file <none>
I20260812 11:10:13.576031 19464 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:13.576131 19464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:13.576352 19464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:13.578462 19464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "b42e31aa7397493a93b6a013d3ef8086"
format_stamp: "Formatted at 2026-08-12 11:10:13 on dist-test-slave-lgr5"
server_key: "893ecef0672f9fa224650cdf653d3acf"
server_key_iv: "9e4c44bc40b354032f1fa268e0ead525"
server_key_version: "encryptionkey@0"
I20260812 11:10:13.579010 19464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "b42e31aa7397493a93b6a013d3ef8086"
format_stamp: "Formatted at 2026-08-12 11:10:13 on dist-test-slave-lgr5"
server_key: "893ecef0672f9fa224650cdf653d3acf"
server_key_iv: "9e4c44bc40b354032f1fa268e0ead525"
server_key_version: "encryptionkey@0"
I20260812 11:10:13.582775 19464 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 11:10:13.585299 19494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:13.586623 19464 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:10:13.586731 19464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "b42e31aa7397493a93b6a013d3ef8086"
format_stamp: "Formatted at 2026-08-12 11:10:13 on dist-test-slave-lgr5"
server_key: "893ecef0672f9fa224650cdf653d3acf"
server_key_iv: "9e4c44bc40b354032f1fa268e0ead525"
server_key_version: "encryptionkey@0"
I20260812 11:10:13.586844 19464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:13.600670 19464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:13.601370 19464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:13.601550 19464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:13.602159 19464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:13.603143 19464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:13.603190 19464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:13.603230 19464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:13.603258 19464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:13.611771 19464 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:43091
I20260812 11:10:13.611809 19687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:43091 every 8 connection(s)
I20260812 11:10:13.612812 19464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:13.617061 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 19464
I20260812 11:10:13.617216 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:13.617547 19131 external_mini_cluster.cc:1428] Setting key a314e4da4d05b5880e4f26f54f1710e5
I20260812 11:10:13.622874 18919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.614735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:53363 (local address 127.18.174.254:44887)
0812 11:10:13.614872 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:13.614878 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:13.615986 (+ 1108us) server_negotiation.cc:407] Connection header received
0812 11:10:13.617726 (+ 1740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:13.617730 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:13.617789 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:13.617871 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:13.619111 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.619860 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.621067 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.621320 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.621415 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.622419 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:13.622422 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:13.622424 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:13.622438 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:13.622460 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:13.622469 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:13.622535 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:13.622688 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 11:10:13.622746 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:10:13.623762 19693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.615144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:44887 (local address 127.18.174.195:53363)
0812 11:10:13.615828 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:13.615879 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:13.617431 (+ 1552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:13.618062 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:13.618072 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:13.618183 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:13.618859 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.618892 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.619995 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.619998 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.620936 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.620947 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.621450 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.621453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.621595 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.622168 (+ 573us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:13.622170 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:13.622211 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:13.622275 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:13.622540 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:13.622544 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:13.622548 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:10:13.622637 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 11:10:13.622862 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":124,"threads_started":1}
I20260812 11:10:13.624924 19688 heartbeater.cc:347] Connected to a master server at 127.18.174.254:44887
I20260812 11:10:13.625145 19688 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:13.625664 19688 heartbeater.cc:511] Master 127.18.174.254:44887 requested a full tablet report, sending...
I20260812 11:10:13.626724 18837 ts_manager.cc:194] Registered new tserver with Master: b42e31aa7397493a93b6a013d3ef8086 (127.18.174.195:43091)
I20260812 11:10:13.627291 18837 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.174.195:53363
I20260812 11:10:13.631614 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:10:13.637329 18919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.633616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33258 (local address 127.18.174.254:44887)
0812 11:10:13.633771 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:13.633775 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:13.633927 (+ 152us) server_negotiation.cc:407] Connection header received
0812 11:10:13.634058 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:13.634061 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:13.634106 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:13.634170 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:13.634454 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.634970 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.635792 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.636015 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.636125 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.636913 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:13.636918 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:13.636921 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:13.636934 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:13.636956 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:13.636964 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:13.637023 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:13.637119 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 11:10:13.637187 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:10:13.640337 18837 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33258:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:10:13.643496 18837 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:13.659682 19710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.653582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43932 (local address 127.18.174.194:33173)
0812 11:10:13.654343 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:13.654354 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:13.654378 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:10:13.654453 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:13.654458 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:13.654641 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:13.655075 (+ 434us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:13.655210 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.656278 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.658050 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.658831 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.658941 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.659140 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:13.659382 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 11:10:13.659497 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":660,"thread_start_us":113,"threads_started":1}
I20260812 11:10:13.659690 19707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.652742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:33173 (local address 127.0.0.1:43932)
0812 11:10:13.653973 (+ 1231us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:13.653993 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:13.654082 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:13.654806 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:13.654809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:13.654829 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:13.654913 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.654918 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.656396 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.656399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.657912 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.657925 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.658949 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.658953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.659124 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.659192 (+ 68us) client_negotiation.cc:769] Sending connection context
0812 11:10:13.659323 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 11:10:13.659493 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1165,"mutex_wait_us":139,"thread_start_us":100,"threads_started":1}
I20260812 11:10:13.660027 19708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.652800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58348 (local address 127.18.174.195:43091)
0812 11:10:13.653548 (+ 748us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:13.653562 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:13.653778 (+ 216us) server_negotiation.cc:407] Connection header received
0812 11:10:13.653875 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:13.653881 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:13.654126 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:13.654289 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:13.654778 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.655986 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.657924 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.658800 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.658941 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.659140 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:13.659468 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 11:10:13.659639 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":186,"threads_started":1}
I20260812 11:10:13.660324 19705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.652697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:43091 (local address 127.0.0.1:58348)
0812 11:10:13.653402 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:13.653466 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:13.653603 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:13.654474 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:13.654480 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:13.654503 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:13.654636 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.654643 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.656142 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.656146 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.657799 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.657810 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.658949 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.658953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.659121 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.659192 (+ 71us) client_negotiation.cc:769] Sending connection context
0812 11:10:13.659365 (+ 173us) client_negotiation.cc:240] Negotiation successful
0812 11:10:13.660198 (+ 833us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":979,"thread_start_us":113,"threads_started":1}
I20260812 11:10:13.663235 19565 tablet_service.cc:1467] Processing CreateTablet for tablet 209bc7ffb14b4eeba9217ce1f2fe4ac9 (DEFAULT_TABLE table=test-table [id=08cee8be322d48fbbab2596db54d96e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:13.663236 19341 tablet_service.cc:1467] Processing CreateTablet for tablet 209bc7ffb14b4eeba9217ce1f2fe4ac9 (DEFAULT_TABLE table=test-table [id=08cee8be322d48fbbab2596db54d96e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:13.664505 19341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 209bc7ffb14b4eeba9217ce1f2fe4ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:13.664505 19565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 209bc7ffb14b4eeba9217ce1f2fe4ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:13.664654 19709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.653457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:36737 (local address 127.0.0.1:52000)
0812 11:10:13.654617 (+ 1160us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:13.654628 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:13.654718 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:13.655107 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:13.655109 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:13.655127 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:13.655220 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.655226 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.656188 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.656192 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.657914 (+ 1722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.657924 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.664224 (+ 6300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.664228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.664321 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.664346 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:10:13.664425 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 11:10:13.664509 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1106,"mutex_wait_us":173,"thread_start_us":97,"threads_started":1}
I20260812 11:10:13.665020 19711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.654001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52000 (local address 127.18.174.193:36737)
0812 11:10:13.654286 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:13.654294 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:13.654720 (+ 426us) server_negotiation.cc:407] Connection header received
0812 11:10:13.654824 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:13.654828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:13.654968 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:13.655113 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:13.655312 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.656043 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.659211 (+ 3168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.664069 (+ 4858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.664235 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.664442 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:13.664494 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 11:10:13.664857 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":106,"threads_started":1}
I20260812 11:10:13.667927 19087 tablet_service.cc:1467] Processing CreateTablet for tablet 209bc7ffb14b4eeba9217ce1f2fe4ac9 (DEFAULT_TABLE table=test-table [id=08cee8be322d48fbbab2596db54d96e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:13.669037 19087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 209bc7ffb14b4eeba9217ce1f2fe4ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:13.672676 19713 tablet_bootstrap.cc:492] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12: Bootstrap starting.
I20260812 11:10:13.673169 19712 tablet_bootstrap.cc:492] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086: Bootstrap starting.
I20260812 11:10:13.675652 19712 tablet_bootstrap.cc:654] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:13.676680 19712 log.cc:824] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:13.678033 19713 tablet_bootstrap.cc:654] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:13.678021 19715 tablet_bootstrap.cc:492] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6: Bootstrap starting.
I20260812 11:10:13.678735 19713 log.cc:824] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:13.679461 19712 tablet_bootstrap.cc:492] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086: No bootstrap required, opened a new log
I20260812 11:10:13.679673 19712 ts_tablet_manager.cc:1397] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 11:10:13.680248 19715 tablet_bootstrap.cc:654] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:13.680562 19713 tablet_bootstrap.cc:492] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12: No bootstrap required, opened a new log
I20260812 11:10:13.680742 19713 ts_tablet_manager.cc:1397] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260812 11:10:13.681077 19715 log.cc:824] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:13.683243 19715 tablet_bootstrap.cc:492] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6: No bootstrap required, opened a new log
I20260812 11:10:13.683458 19715 ts_tablet_manager.cc:1397] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260812 11:10:13.684042 19712 raft_consensus.cc:348] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b42e31aa7397493a93b6a013d3ef8086" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43091 } } peers { permanent_uuid: "5b940ab725054c7f96eb4423371b9b12" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33173 } } peers { permanent_uuid: "afcee80744334311aa92463fc9517ef6" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36737 } }
I20260812 11:10:13.684139 19713 raft_consensus.cc:348] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b42e31aa7397493a93b6a013d3ef8086" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43091 } } peers { permanent_uuid: "5b940ab725054c7f96eb4423371b9b12" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33173 } } peers { permanent_uuid: "afcee80744334311aa92463fc9517ef6" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36737 } }
I20260812 11:10:13.684393 19713 raft_consensus.cc:374] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:13.684393 19712 raft_consensus.cc:374] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:13.684446 19712 raft_consensus.cc:729] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b42e31aa7397493a93b6a013d3ef8086, State: Initialized, Role: FOLLOWER
I20260812 11:10:13.684443 19713 raft_consensus.cc:729] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b940ab725054c7f96eb4423371b9b12, State: Initialized, Role: FOLLOWER
I20260812 11:10:13.684922 19712 consensus_queue.cc:260] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b42e31aa7397493a93b6a013d3ef8086" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43091 } } peers { permanent_uuid: "5b940ab725054c7f96eb4423371b9b12" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33173 } } peers { permanent_uuid: "afcee80744334311aa92463fc9517ef6" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36737 } }
I20260812 11:10:13.684937 19713 consensus_queue.cc:260] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b42e31aa7397493a93b6a013d3ef8086" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43091 } } peers { permanent_uuid: "5b940ab725054c7f96eb4423371b9b12" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33173 } } peers { permanent_uuid: "afcee80744334311aa92463fc9517ef6" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36737 } }
I20260812 11:10:13.685889 19713 ts_tablet_manager.cc:1428] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 11:10:13.685943 19712 ts_tablet_manager.cc:1428] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 11:10:13.686271 19688 heartbeater.cc:503] Master 127.18.174.254:44887 was elected leader, sending a full tablet report...
I20260812 11:10:13.686256 19459 heartbeater.cc:503] Master 127.18.174.254:44887 was elected leader, sending a full tablet report...
I20260812 11:10:13.687422 19715 raft_consensus.cc:348] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b42e31aa7397493a93b6a013d3ef8086" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43091 } } peers { permanent_uuid: "5b940ab725054c7f96eb4423371b9b12" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33173 } } peers { permanent_uuid: "afcee80744334311aa92463fc9517ef6" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36737 } }
I20260812 11:10:13.687702 19715 raft_consensus.cc:374] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:13.687762 19715 raft_consensus.cc:729] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afcee80744334311aa92463fc9517ef6, State: Initialized, Role: FOLLOWER
I20260812 11:10:13.688235 19715 consensus_queue.cc:260] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b42e31aa7397493a93b6a013d3ef8086" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43091 } } peers { permanent_uuid: "5b940ab725054c7f96eb4423371b9b12" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33173 } } peers { permanent_uuid: "afcee80744334311aa92463fc9517ef6" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36737 } }
I20260812 11:10:13.688925 19219 heartbeater.cc:503] Master 127.18.174.254:44887 was elected leader, sending a full tablet report...
I20260812 11:10:13.689225 19715 ts_tablet_manager.cc:1428] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260812 11:10:13.699887 19220 tablet.cc:2369] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:13.790939 19726 raft_consensus.cc:482] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:13.791203 19726 raft_consensus.cc:504] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b42e31aa7397493a93b6a013d3ef8086" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43091 } } peers { permanent_uuid: "5b940ab725054c7f96eb4423371b9b12" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33173 } } peers { permanent_uuid: "afcee80744334311aa92463fc9517ef6" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36737 } }
I20260812 11:10:13.792858 19726 leader_election.cc:288] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b940ab725054c7f96eb4423371b9b12 (127.18.174.194:33173), afcee80744334311aa92463fc9517ef6 (127.18.174.193:36737)
I20260812 11:10:13.796659 19710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.793286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:46253 (local address 127.18.174.194:33173)
0812 11:10:13.793421 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:13.793424 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:13.793437 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:10:13.793492 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:13.793495 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:13.793538 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:13.793623 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:13.793959 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.794472 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.795606 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.796060 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.796199 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.796257 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:13.796457 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 11:10:13.796531 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 11:10:13.796659 19693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.793102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:33173 (local address 127.18.174.195:46253)
0812 11:10:13.793222 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:13.793236 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:13.793342 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:13.793661 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:13.793664 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:13.793686 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:13.793824 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.793830 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.794581 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.794584 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.795455 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.795466 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.796197 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.796201 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.796334 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.796359 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:10:13.796434 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 11:10:13.796513 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"spinlock_wait_cycles":12672}
I20260812 11:10:13.796821 19711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.793224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:49989 (local address 127.18.174.193:36737)
0812 11:10:13.793349 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:13.793354 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:13.793718 (+ 364us) server_negotiation.cc:407] Connection header received
0812 11:10:13.793845 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:13.793849 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:13.793900 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:13.793963 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:13.794240 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.794745 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.795826 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.796290 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.796413 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.796485 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:13.796627 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 11:10:13.796701 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:10:13.796846 19728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.793102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:36737 (local address 127.18.174.195:49989)
0812 11:10:13.793608 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:13.793622 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:13.793743 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:13.793982 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:13.793985 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:13.794001 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:13.794132 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.794137 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.794858 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.794861 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.795699 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:13.795709 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.796421 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.796424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:13.796517 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.796539 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 11:10:13.796609 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 11:10:13.796675 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":137,"thread_start_us":164,"threads_started":1}
I20260812 11:10:13.797479 19373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209bc7ffb14b4eeba9217ce1f2fe4ac9" candidate_uuid: "b42e31aa7397493a93b6a013d3ef8086" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b940ab725054c7f96eb4423371b9b12" is_pre_election: true
I20260812 11:10:13.797596 19127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209bc7ffb14b4eeba9217ce1f2fe4ac9" candidate_uuid: "b42e31aa7397493a93b6a013d3ef8086" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afcee80744334311aa92463fc9517ef6" is_pre_election: true
I20260812 11:10:13.797848 19373 raft_consensus.cc:2454] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b42e31aa7397493a93b6a013d3ef8086 in term 0.
I20260812 11:10:13.797848 19127 raft_consensus.cc:2454] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b42e31aa7397493a93b6a013d3ef8086 in term 0.
I20260812 11:10:13.798390 19499 leader_election.cc:302] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b940ab725054c7f96eb4423371b9b12, b42e31aa7397493a93b6a013d3ef8086; no voters:
I20260812 11:10:13.798702 19726 raft_consensus.cc:2781] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:13.798789 19726 raft_consensus.cc:482] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:13.798825 19726 raft_consensus.cc:3037] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:13.799968 19726 raft_consensus.cc:504] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b42e31aa7397493a93b6a013d3ef8086" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43091 } } peers { permanent_uuid: "5b940ab725054c7f96eb4423371b9b12" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33173 } } peers { permanent_uuid: "afcee80744334311aa92463fc9517ef6" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36737 } }
I20260812 11:10:13.800371 19726 leader_election.cc:288] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [CANDIDATE]: Term 1 election: Requested vote from peers 5b940ab725054c7f96eb4423371b9b12 (127.18.174.194:33173), afcee80744334311aa92463fc9517ef6 (127.18.174.193:36737)
I20260812 11:10:13.800729 19373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209bc7ffb14b4eeba9217ce1f2fe4ac9" candidate_uuid: "b42e31aa7397493a93b6a013d3ef8086" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b940ab725054c7f96eb4423371b9b12"
I20260812 11:10:13.800771 19127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "209bc7ffb14b4eeba9217ce1f2fe4ac9" candidate_uuid: "b42e31aa7397493a93b6a013d3ef8086" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afcee80744334311aa92463fc9517ef6"
I20260812 11:10:13.800868 19373 raft_consensus.cc:3037] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:13.800894 19127 raft_consensus.cc:3037] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:13.801925 19373 raft_consensus.cc:2454] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b42e31aa7397493a93b6a013d3ef8086 in term 1.
I20260812 11:10:13.802002 19127 raft_consensus.cc:2454] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b42e31aa7397493a93b6a013d3ef8086 in term 1.
I20260812 11:10:13.802264 19499 leader_election.cc:302] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b940ab725054c7f96eb4423371b9b12, b42e31aa7397493a93b6a013d3ef8086; no voters:
I20260812 11:10:13.802448 19726 raft_consensus.cc:2781] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:13.802680 19726 raft_consensus.cc:686] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [term 1 LEADER]: Becoming Leader. State: Replica: b42e31aa7397493a93b6a013d3ef8086, State: Running, Role: LEADER
I20260812 11:10:13.803037 19726 consensus_queue.cc:237] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b42e31aa7397493a93b6a013d3ef8086" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43091 } } peers { permanent_uuid: "5b940ab725054c7f96eb4423371b9b12" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33173 } } peers { permanent_uuid: "afcee80744334311aa92463fc9517ef6" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36737 } }
I20260812 11:10:13.806617 18837 catalog_manager.cc:5495] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 reported cstate change: term changed from 0 to 1, leader changed from <none> to b42e31aa7397493a93b6a013d3ef8086 (127.18.174.195). New cstate: current_term: 1 leader_uuid: "b42e31aa7397493a93b6a013d3ef8086" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b42e31aa7397493a93b6a013d3ef8086" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 43091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b940ab725054c7f96eb4423371b9b12" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afcee80744334311aa92463fc9517ef6" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260812 11:10:13.853479 19708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.849752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58356 (local address 127.18.174.195:43091)
0812 11:10:13.849888 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:13.849892 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:13.849906 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:10:13.850036 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:13.850039 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:13.850098 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:13.850191 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:13.850493 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.851006 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.851933 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.852187 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.852278 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.852621 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:13.853110 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:13.853225 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:13.853290 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 11:10:13.853355 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:10:13.859988 19373 raft_consensus.cc:1261] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12 [term 1 FOLLOWER]: Refusing update from remote peer b42e31aa7397493a93b6a013d3ef8086: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:13.859988 19127 raft_consensus.cc:1261] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6 [term 1 FOLLOWER]: Refusing update from remote peer b42e31aa7397493a93b6a013d3ef8086: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:13.860770 19726 consensus_queue.cc:1035] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afcee80744334311aa92463fc9517ef6" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:13.860997 19731 consensus_queue.cc:1035] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b940ab725054c7f96eb4423371b9b12" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 33173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:10:13.863837 19690 tablet.cc:2369] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:13.869109 19735 mvcc.cc:205] Tried to move back new op lower bound from 7317639224762167296 to 7317639224540012544. Current Snapshot: MvccSnapshot[applied={T|T < 7317639224762167296}]
I20260812 11:10:13.870330 19739 mvcc.cc:205] Tried to move back new op lower bound from 7317639224762167296 to 7317639224540012544. Current Snapshot: MvccSnapshot[applied={T|T < 7317639224762167296}]
I20260812 11:10:13.879318 18837 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:13.879491 18837 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:13.881984 18837 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e1b0905ef0e24305bb601400faf1d5b4: Sending DeleteTablet for 3 replicas of tablet 209bc7ffb14b4eeba9217ce1f2fe4ac9
I20260812 11:10:13.882809 19341 tablet_service.cc:1514] Processing DeleteTablet for tablet 209bc7ffb14b4eeba9217ce1f2fe4ac9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:13 UTC) from {username='slave'} at 127.0.0.1:43932
I20260812 11:10:13.882812 19565 tablet_service.cc:1514] Processing DeleteTablet for tablet 209bc7ffb14b4eeba9217ce1f2fe4ac9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:13 UTC) from {username='slave'} at 127.0.0.1:58348
I20260812 11:10:13.882869 19087 tablet_service.cc:1514] Processing DeleteTablet for tablet 209bc7ffb14b4eeba9217ce1f2fe4ac9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:13 UTC) from {username='slave'} at 127.0.0.1:52000
I20260812 11:10:13.883496 19757 tablet_replica.cc:330] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12: stopping tablet replica
I20260812 11:10:13.883554 19758 tablet_replica.cc:330] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6: stopping tablet replica
I20260812 11:10:13.883913 19758 raft_consensus.cc:2229] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:13.883913 19757 raft_consensus.cc:2229] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:13.884104 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 18956
I20260812 11:10:13.884275 19758 raft_consensus.cc:2258] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P afcee80744334311aa92463fc9517ef6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:13.884418 19757 raft_consensus.cc:2258] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:13.889039 19757 ts_tablet_manager.cc:1905] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:13.892207 19757 ts_tablet_manager.cc:1918] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:13.892377 19757 log.cc:1196] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/209bc7ffb14b4eeba9217ce1f2fe4ac9
I20260812 11:10:13.892758 19757 ts_tablet_manager.cc:1939] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P 5b940ab725054c7f96eb4423371b9b12: Deleting consensus metadata
I20260812 11:10:13.894435 18825 catalog_manager.cc:4841] TS 5b940ab725054c7f96eb4423371b9b12 (127.18.174.194:33173): tablet 209bc7ffb14b4eeba9217ce1f2fe4ac9 (table test-table [id=08cee8be322d48fbbab2596db54d96e1]) successfully deleted
I20260812 11:10:13.899051 19759 tablet_replica.cc:330] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086: stopping tablet replica
I20260812 11:10:13.899466 19759 raft_consensus.cc:2229] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:10:13.899966 19759 raft_consensus.cc:2258] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:13.901584 19759 ts_tablet_manager.cc:1905] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:13.904477 19759 ts_tablet_manager.cc:1918] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:13.904585 19759 log.cc:1196] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/209bc7ffb14b4eeba9217ce1f2fe4ac9
I20260812 11:10:13.904907 19759 ts_tablet_manager.cc:1939] T 209bc7ffb14b4eeba9217ce1f2fe4ac9 P b42e31aa7397493a93b6a013d3ef8086: Deleting consensus metadata
W20260812 11:10:13.905427 18820 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:36737 (error 108)
I20260812 11:10:13.906198 18824 catalog_manager.cc:4841] TS b42e31aa7397493a93b6a013d3ef8086 (127.18.174.195:43091): tablet 209bc7ffb14b4eeba9217ce1f2fe4ac9 (table test-table [id=08cee8be322d48fbbab2596db54d96e1]) successfully deleted
I20260812 11:10:13.906495 19709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.906179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:36737 (local address 127.0.0.1:52012)
0812 11:10:13.906317 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:13.906401 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:36737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 11:10:13.906625 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 19222
W20260812 11:10:13.906678 18820 catalog_manager.cc:4584] TS afcee80744334311aa92463fc9517ef6 (127.18.174.193:36737): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 209bc7ffb14b4eeba9217ce1f2fe4ac9: Network error: Client connection negotiation failed: client connection to 127.18.174.193:36737: connect: Connection refused (error 111)
I20260812 11:10:13.931692 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 19464
I20260812 11:10:13.941696 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 18794
2026-08-12T11:10:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1250 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:14 dist-test-slave-lgr5 krb5kdc[19766](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:14 dist-test-slave-lgr5 krb5kdc[19766](info): set up 2 sockets
Aug 12 11:10:14 dist-test-slave-lgr5 krb5kdc[19766](info): commencing operation
krb5kdc: starting...
W20260812 11:10:15.187937 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:15 dist-test-slave-lgr5 krb5kdc[19766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:10:15.316933 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:43661
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:34825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:43661
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:15.433027 19790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:15.433374 19790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:15.433418 19790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:15.437520 19790 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:15.437600 19790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:15.437619 19790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:15.437634 19790 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:15.437647 19790 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:15.443166 19790 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:34825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:43661
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:43661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:15.444371 19790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:15.445385 19790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:15.454048 19804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:15.454209 19799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:15.454092 19800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:15.454434 19790 server_base.cc:1034] running on GCE node
I20260812 11:10:15.454988 19790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:15.456167 19790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:15.457329 19790 hybrid_clock.cc:648] HybridClock initialized: now 1786533015457308 us; error 42 us; skew 500 ppm
Aug 12 11:10:15 dist-test-slave-lgr5 krb5kdc[19766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533015, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:15.460009 19790 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:10:15.460925 19790 webserver.cc:460] Webserver started at http://127.18.174.254:45163/ using document root <none> and password file <none>
I20260812 11:10:15.461449 19790 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:15.461505 19790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:15.461671 19790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:15.463717 19790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "757eab0b84d24ba9ae42007062bd9f51"
format_stamp: "Formatted at 2026-08-12 11:10:15 on dist-test-slave-lgr5"
server_key: "1091331d4197696b0bf503c81d598556"
server_key_iv: "4ffafd9c79c852dfd0893a2b2286726e"
server_key_version: "encryptionkey@0"
I20260812 11:10:15.464291 19790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "757eab0b84d24ba9ae42007062bd9f51"
format_stamp: "Formatted at 2026-08-12 11:10:15 on dist-test-slave-lgr5"
server_key: "1091331d4197696b0bf503c81d598556"
server_key_iv: "4ffafd9c79c852dfd0893a2b2286726e"
server_key_version: "encryptionkey@0"
I20260812 11:10:15.468024 19790 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 11:10:15.470603 19816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:15.471896 19790 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260812 11:10:15.472012 19790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "757eab0b84d24ba9ae42007062bd9f51"
format_stamp: "Formatted at 2026-08-12 11:10:15 on dist-test-slave-lgr5"
server_key: "1091331d4197696b0bf503c81d598556"
server_key_iv: "4ffafd9c79c852dfd0893a2b2286726e"
server_key_version: "encryptionkey@0"
I20260812 11:10:15.472174 19790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:15.498117 19790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:15.501644 19790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:15.501840 19790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:15.509423 19790 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:43661
I20260812 11:10:15.509438 19905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:43661 every 8 connection(s)
I20260812 11:10:15.510604 19790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:15.513728 19908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:15.514740 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 19790
I20260812 11:10:15.514887 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:15.515194 19131 external_mini_cluster.cc:1428] Setting key 3abb19376bbd434121df29e23773af7c
I20260812 11:10:15.520363 19908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51: Bootstrap starting.
I20260812 11:10:15.523064 19908 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:15.524015 19908 log.cc:824] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:10:15 dist-test-slave-lgr5 krb5kdc[19766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:15.526547 19908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51: No bootstrap required, opened a new log
I20260812 11:10:15.529981 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.516656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58752 (local address 127.18.174.254:43661)
0812 11:10:15.517071 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:15.517087 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:15.517126 (+ 39us) server_negotiation.cc:407] Connection header received
0812 11:10:15.517782 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:15.517799 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:15.518154 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:15.518435 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:15.519361 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.520416 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.521553 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.522032 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.522145 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.524935 (+ 2790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:15.524941 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:15.524960 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:15.524990 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:15.526820 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:15.527256 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:15.527263 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:15.527269 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:15.527419 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:15.527641 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:15.527645 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:15.527647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:15.528209 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:15.528408 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:15.528618 (+ 210us) server_negotiation.cc:299] Negotiation successful
0812 11:10:15.528964 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":110,"threads_started":1}
I20260812 11:10:15.531291 19908 raft_consensus.cc:348] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "757eab0b84d24ba9ae42007062bd9f51" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 43661 } }
I20260812 11:10:15.531535 19908 raft_consensus.cc:374] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:15.531592 19908 raft_consensus.cc:729] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 757eab0b84d24ba9ae42007062bd9f51, State: Initialized, Role: FOLLOWER
I20260812 11:10:15.532143 19908 consensus_queue.cc:260] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "757eab0b84d24ba9ae42007062bd9f51" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 43661 } }
I20260812 11:10:15.532323 19908 raft_consensus.cc:388] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:15.532399 19908 raft_consensus.cc:482] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:15.532523 19908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:15.533496 19908 raft_consensus.cc:504] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "757eab0b84d24ba9ae42007062bd9f51" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 43661 } }
I20260812 11:10:15.533840 19908 leader_election.cc:302] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 757eab0b84d24ba9ae42007062bd9f51; no voters:
I20260812 11:10:15.534180 19908 leader_election.cc:288] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:15.534287 19919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:15.534561 19919 raft_consensus.cc:686] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [term 1 LEADER]: Becoming Leader. State: Replica: 757eab0b84d24ba9ae42007062bd9f51, State: Running, Role: LEADER
I20260812 11:10:15.534893 19919 consensus_queue.cc:237] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "757eab0b84d24ba9ae42007062bd9f51" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 43661 } }
I20260812 11:10:15.535437 19908 sys_catalog.cc:564] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:15.536518 19925 sys_catalog.cc:455] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 757eab0b84d24ba9ae42007062bd9f51. Latest consensus state: current_term: 1 leader_uuid: "757eab0b84d24ba9ae42007062bd9f51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "757eab0b84d24ba9ae42007062bd9f51" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 43661 } } }
I20260812 11:10:15.536655 19925 sys_catalog.cc:458] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:15.536980 19921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "757eab0b84d24ba9ae42007062bd9f51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "757eab0b84d24ba9ae42007062bd9f51" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 43661 } } }
I20260812 11:10:15.537050 19937 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:15.537153 19921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:15.540591 19937 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:15.546101 19937 catalog_manager.cc:1347] Generated new cluster ID: 0a881922747b4956b8ff86619014c2f8
I20260812 11:10:15.546181 19937 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:15.552315 19937 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:15.553691 19937 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:15.565412 19937 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51: Generated new TSK 0
I20260812 11:10:15.566346 19937 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:10:15.599076 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:43661
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:34825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:15.718475 19961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:15.718779 19961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:15.718825 19961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:15.723002 19961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:15.723078 19961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:15.723140 19961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:10:15.728742 19961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:34825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:43661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:15.729918 19961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:15.730989 19961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:15.741194 19976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:15.741184 19980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:15.741159 19973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:15.741443 19961 server_base.cc:1034] running on GCE node
I20260812 11:10:15.741972 19961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:15.742677 19961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:15.743831 19961 hybrid_clock.cc:648] HybridClock initialized: now 1786533015743803 us; error 57 us; skew 500 ppm
Aug 12 11:10:15 dist-test-slave-lgr5 krb5kdc[19766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533015, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:15.746649 19961 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:10:15.747594 19961 webserver.cc:460] Webserver started at http://127.18.174.193:45909/ using document root <none> and password file <none>
I20260812 11:10:15.748193 19961 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:15.748261 19961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:15.748456 19961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:15.750555 19961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "e8a264947f0c40db8bf95d2843b08343"
format_stamp: "Formatted at 2026-08-12 11:10:15 on dist-test-slave-lgr5"
server_key: "411a2821dc719ae6e3853519183c2a7b"
server_key_iv: "83c3a81dea3b263dcef745545264c735"
server_key_version: "encryptionkey@0"
I20260812 11:10:15.751101 19961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "e8a264947f0c40db8bf95d2843b08343"
format_stamp: "Formatted at 2026-08-12 11:10:15 on dist-test-slave-lgr5"
server_key: "411a2821dc719ae6e3853519183c2a7b"
server_key_iv: "83c3a81dea3b263dcef745545264c735"
server_key_version: "encryptionkey@0"
I20260812 11:10:15.754976 19961 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:10:15.757527 19988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:15.758862 19961 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:10:15.758982 19961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "e8a264947f0c40db8bf95d2843b08343"
format_stamp: "Formatted at 2026-08-12 11:10:15 on dist-test-slave-lgr5"
server_key: "411a2821dc719ae6e3853519183c2a7b"
server_key_iv: "83c3a81dea3b263dcef745545264c735"
server_key_version: "encryptionkey@0"
I20260812 11:10:15.759073 19961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:15.779830 19961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:15.782997 19961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:15.783193 19961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:15.783844 19961 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:15.784751 19961 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:15.784811 19961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:15.784868 19961 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:15.784893 19961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:15.793905 19961 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:34751
I20260812 11:10:15.793974 20190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:34751 every 8 connection(s)
I20260812 11:10:15.794860 19961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:15.796949 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 19961
I20260812 11:10:15.797082 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:15.797391 19131 external_mini_cluster.cc:1428] Setting key 6b30020bf65bb0ccc9af1f3332160051
Aug 12 11:10:15 dist-test-slave-lgr5 krb5kdc[19766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533015, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
I20260812 11:10:15.809784 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.796734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:57145 (local address 127.18.174.254:43661)
0812 11:10:15.796906 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:15.796911 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:15.797814 (+ 903us) server_negotiation.cc:407] Connection header received
0812 11:10:15.799134 (+ 1320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:15.799137 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:15.799191 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:15.799286 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:15.800598 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.801155 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.802798 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.803036 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.803127 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.806296 (+ 3169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:15.806300 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:15.806302 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:15.806329 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:15.807673 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:15.808289 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:15.808292 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:15.808293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:15.808371 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:15.808697 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:15.808699 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:15.808700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:15.808890 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:15.808982 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:15.809518 (+ 536us) server_negotiation.cc:299] Negotiation successful
0812 11:10:15.809645 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:10:15.810559 20198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.797146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:43661 (local address 127.18.174.193:57145)
0812 11:10:15.797646 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:15.797701 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:15.798923 (+ 1222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:15.799431 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:15.799438 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:15.799824 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:15.800409 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.800426 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.801282 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.801285 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.802632 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.802646 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.803206 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.803210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.803442 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.804190 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:15.804214 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:15.806083 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:15.807796 (+ 1713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:15.807802 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:15.807820 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:15.808205 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:15.808449 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:15.808451 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:15.808452 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:15.808623 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:15.808978 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:15.808984 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:15.809240 (+ 256us) client_negotiation.cc:769] Sending connection context
0812 11:10:15.809395 (+ 155us) client_negotiation.cc:240] Negotiation successful
0812 11:10:15.809689 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":119,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
I20260812 11:10:15.811848 20193 heartbeater.cc:347] Connected to a master server at 127.18.174.254:43661
I20260812 11:10:15.812155 20193 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:15.812789 20193 heartbeater.cc:511] Master 127.18.174.254:43661 requested a full tablet report, sending...
I20260812 11:10:15.814532 19850 ts_manager.cc:194] Registered new tserver with Master: e8a264947f0c40db8bf95d2843b08343 (127.18.174.193:34751)
I20260812 11:10:15.816171 19850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:57145
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:10:15.827006 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:43661
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:34825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:15.941167 20202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:15.941422 20202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:15.941464 20202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:15.945410 20202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:15.945466 20202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:15.945524 20202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:10:15.950784 20202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:34825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:43661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:15.951870 20202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:15.952947 20202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:15.962467 20213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:15.962536 20209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:15.962589 20210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:15.962936 20202 server_base.cc:1034] running on GCE node
I20260812 11:10:15.963371 20202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:15.964008 20202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:15.965160 20202 hybrid_clock.cc:648] HybridClock initialized: now 1786533015965129 us; error 43 us; skew 500 ppm
Aug 12 11:10:15 dist-test-slave-lgr5 krb5kdc[19766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533015, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:15.967887 20202 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:10:15.968854 20202 webserver.cc:460] Webserver started at http://127.18.174.194:46251/ using document root <none> and password file <none>
I20260812 11:10:15.969419 20202 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:15.969480 20202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:15.969684 20202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:15.971915 20202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "36a5988aa8e4422b977d15a1788cc6da"
format_stamp: "Formatted at 2026-08-12 11:10:15 on dist-test-slave-lgr5"
server_key: "414ce134c2432e3750d222b0c5b7c657"
server_key_iv: "0f56cb1e4026aa96603e780cbcb749c0"
server_key_version: "encryptionkey@0"
I20260812 11:10:15.972635 20202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "36a5988aa8e4422b977d15a1788cc6da"
format_stamp: "Formatted at 2026-08-12 11:10:15 on dist-test-slave-lgr5"
server_key: "414ce134c2432e3750d222b0c5b7c657"
server_key_iv: "0f56cb1e4026aa96603e780cbcb749c0"
server_key_version: "encryptionkey@0"
I20260812 11:10:15.981904 20202 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.004s sys 0.000s
I20260812 11:10:15.985054 20224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:15.986608 20202 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:10:15.986735 20202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "36a5988aa8e4422b977d15a1788cc6da"
format_stamp: "Formatted at 2026-08-12 11:10:15 on dist-test-slave-lgr5"
server_key: "414ce134c2432e3750d222b0c5b7c657"
server_key_iv: "0f56cb1e4026aa96603e780cbcb749c0"
server_key_version: "encryptionkey@0"
I20260812 11:10:15.986871 20202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:16.002550 20202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:16.006011 20202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:16.006192 20202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:16.006821 20202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:16.007706 20202 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:16.007762 20202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:16.007807 20202 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:16.007835 20202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:16.016758 20202 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:37085
I20260812 11:10:16.016786 20411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:37085 every 8 connection(s)
I20260812 11:10:16.017765 20202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:16.024179 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 20202
I20260812 11:10:16.024307 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:16.024590 19131 external_mini_cluster.cc:1428] Setting key 6b66cb1ee869041d7af8089aef9dec7d
Aug 12 11:10:16 dist-test-slave-lgr5 krb5kdc[19766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533015, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:16.032220 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.019577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:55123 (local address 127.18.174.254:43661)
0812 11:10:16.019704 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.019707 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.020584 (+ 877us) server_negotiation.cc:407] Connection header received
0812 11:10:16.021937 (+ 1353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.021940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.022001 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.022081 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:16.023301 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.023861 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.025235 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.025511 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.025595 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.028384 (+ 2789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:16.028388 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:16.028390 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:16.028417 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:16.029915 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:16.030507 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:16.030511 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:16.030512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:16.030599 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:16.030960 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:16.030962 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:16.030963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:16.031141 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:16.031213 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.031911 (+ 698us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.032049 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:10:16.033416 20415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.019919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:43661 (local address 127.18.174.194:55123)
0812 11:10:16.020419 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:16.020467 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:16.021714 (+ 1247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:16.022280 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:16.022289 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:16.022643 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:16.023154 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.023169 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.024014 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.024017 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.025112 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.025125 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.025663 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.025667 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.025860 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.026562 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:16.026579 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:16.028198 (+ 1619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:16.030034 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:16.030041 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:16.030059 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:16.030384 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:16.030685 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:16.030688 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:16.030690 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:16.030881 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:16.031232 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:16.031239 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:16.031603 (+ 364us) client_negotiation.cc:769] Sending connection context
0812 11:10:16.031829 (+ 226us) client_negotiation.cc:240] Negotiation successful
0812 11:10:16.032276 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":148,"threads_started":1}
I20260812 11:10:16.034590 20412 heartbeater.cc:347] Connected to a master server at 127.18.174.254:43661
I20260812 11:10:16.034837 20412 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:16.035365 20412 heartbeater.cc:511] Master 127.18.174.254:43661 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
I20260812 11:10:16.036502 19850 ts_manager.cc:194] Registered new tserver with Master: 36a5988aa8e4422b977d15a1788cc6da (127.18.174.194:37085)
I20260812 11:10:16.037137 19850 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:55123
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:10:16.055437 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:43661
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:34825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:16.170287 20423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:16.170558 20423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:16.170619 20423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:16.174656 20423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:16.174712 20423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:16.174788 20423 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:10:16.179973 20423 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:34825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:43661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:16.181063 20423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:16.182075 20423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:16.192201 20438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:16.192198 20434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:16.192189 20435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:16.192417 20423 server_base.cc:1034] running on GCE node
I20260812 11:10:16.192957 20423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:16.193629 20423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:16.194813 20423 hybrid_clock.cc:648] HybridClock initialized: now 1786533016194791 us; error 33 us; skew 500 ppm
Aug 12 11:10:16 dist-test-slave-lgr5 krb5kdc[19766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533016, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:16.197786 20423 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:10:16.198704 20423 webserver.cc:460] Webserver started at http://127.18.174.195:38685/ using document root <none> and password file <none>
I20260812 11:10:16.199254 20423 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:16.199312 20423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:16.199496 20423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:16.201676 20423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "146513c0fef24f0781d134e6723fb5cf"
format_stamp: "Formatted at 2026-08-12 11:10:16 on dist-test-slave-lgr5"
server_key: "5905ad203aece66af81cca8a801418bb"
server_key_iv: "34eef2f4da49b92b6b73072feed36640"
server_key_version: "encryptionkey@0"
I20260812 11:10:16.202291 20423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "146513c0fef24f0781d134e6723fb5cf"
format_stamp: "Formatted at 2026-08-12 11:10:16 on dist-test-slave-lgr5"
server_key: "5905ad203aece66af81cca8a801418bb"
server_key_iv: "34eef2f4da49b92b6b73072feed36640"
server_key_version: "encryptionkey@0"
I20260812 11:10:16.206346 20423 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:10:16.209115 20450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:16.210532 20423 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:16.210671 20423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "146513c0fef24f0781d134e6723fb5cf"
format_stamp: "Formatted at 2026-08-12 11:10:16 on dist-test-slave-lgr5"
server_key: "5905ad203aece66af81cca8a801418bb"
server_key_iv: "34eef2f4da49b92b6b73072feed36640"
server_key_version: "encryptionkey@0"
I20260812 11:10:16.210785 20423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:16.222719 20423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:16.226150 20423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:16.226339 20423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:16.226926 20423 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:16.227823 20423 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:16.227875 20423 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:16.227921 20423 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:16.227946 20423 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:16.237432 20423 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:46209
I20260812 11:10:16.237455 20632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:46209 every 8 connection(s)
I20260812 11:10:16.238361 20423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:16.242717 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 20423
I20260812 11:10:16.242862 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:16.243211 19131 external_mini_cluster.cc:1428] Setting key 732f870a10c6cc40d236e0a0aa3e3291
Aug 12 11:10:16 dist-test-slave-lgr5 krb5kdc[19766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533016, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:16.252604 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.240177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:46317 (local address 127.18.174.254:43661)
0812 11:10:16.240333 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.240337 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.241171 (+ 834us) server_negotiation.cc:407] Connection header received
0812 11:10:16.242508 (+ 1337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.242511 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.242572 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.242661 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:16.244055 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.244774 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.246137 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.246357 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.246443 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.249113 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:16.249117 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:16.249119 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:16.249147 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:16.250547 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:16.251013 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:16.251015 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:16.251017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:16.251085 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:16.251452 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:16.251454 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:16.251455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:16.251678 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:16.251753 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.252351 (+ 598us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.252470 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:10:16.253419 20639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.240544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:43661 (local address 127.18.174.195:46317)
0812 11:10:16.241015 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:16.241058 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:16.242245 (+ 1187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:16.242872 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:16.242882 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:16.243404 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:16.243936 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.243951 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.244914 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.244918 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.246015 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.246027 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.246511 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.246519 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.246688 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.247357 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:16.247374 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:16.248929 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:16.250664 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:16.250669 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:16.250682 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:16.250938 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:16.251186 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:16.251189 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:16.251190 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:16.251344 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:16.251783 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:16.251791 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:16.252061 (+ 270us) client_negotiation.cc:769] Sending connection context
0812 11:10:16.252263 (+ 202us) client_negotiation.cc:240] Negotiation successful
0812 11:10:16.252568 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":117,"threads_started":1}
I20260812 11:10:16.254603 20635 heartbeater.cc:347] Connected to a master server at 127.18.174.254:43661
I20260812 11:10:16.254827 20635 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:16.255317 20635 heartbeater.cc:511] Master 127.18.174.254:43661 requested a full tablet report, sending...
I20260812 11:10:16.256464 19849 ts_manager.cc:194] Registered new tserver with Master: 146513c0fef24f0781d134e6723fb5cf (127.18.174.195:46209)
I20260812 11:10:16.257320 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:10:16.257342 19849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:46317
I20260812 11:10:16.266749 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.259522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58768 (local address 127.18.174.254:43661)
0812 11:10:16.259655 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.259659 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.259817 (+ 158us) server_negotiation.cc:407] Connection header received
0812 11:10:16.259916 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.259918 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.259956 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.260019 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:16.260797 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.261295 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.262146 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.262352 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.262431 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.264024 (+ 1593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:16.264027 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:16.264029 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:16.264052 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:16.265208 (+ 1156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:16.265689 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:16.265692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:16.265693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:16.265763 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:16.265991 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:16.265993 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:16.265995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:16.266185 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:16.266300 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.266509 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.266590 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:10:16.269989 19849 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58768:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:10:16.273082 19849 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:16.287704 20654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.281913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:37085 (local address 127.0.0.1:49782)
0812 11:10:16.282813 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:16.282825 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:16.282901 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:16.283775 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:16.283777 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:16.283793 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:16.283880 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.283884 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.285141 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.285144 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.286300 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.286307 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.287117 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.287121 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.287248 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.287289 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 11:10:16.287418 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 11:10:16.287550 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":844,"mutex_wait_us":10,"thread_start_us":114,"threads_started":1}
I20260812 11:10:16.287710 20659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.282613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49782 (local address 127.18.174.194:37085)
0812 11:10:16.283370 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.283381 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.283402 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:10:16.283473 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.283478 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.283652 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.283802 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:16.283944 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.285012 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.286423 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.286999 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.287116 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.287262 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.287458 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.287563 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":106,"threads_started":1}
I20260812 11:10:16.287938 20655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.281802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:34751 (local address 127.0.0.1:59670)
0812 11:10:16.282274 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:16.282323 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:16.282451 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:16.283265 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:16.283271 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:16.283298 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:16.283444 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.283454 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.284861 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.284864 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.286252 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.286264 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.287562 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.287566 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.287661 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.287684 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:10:16.287752 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 11:10:16.287818 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":97,"threads_started":1}
I20260812 11:10:16.288411 20657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.281958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59670 (local address 127.18.174.193:34751)
0812 11:10:16.282735 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.282752 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.282777 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:10:16.282873 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.282879 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.283096 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.283253 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:16.283548 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.284756 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.286406 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.287234 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.287367 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.287501 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.288174 (+ 673us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.288279 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":68,"threads_started":1}
I20260812 11:10:16.289547 20658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.282522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:46209 (local address 127.0.0.1:34742)
0812 11:10:16.284232 (+ 1710us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:16.284243 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:16.284327 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:16.284702 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:16.284705 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:16.284721 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:16.284815 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.284821 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.286060 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.286063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.287275 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.287287 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.289155 (+ 1868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.289158 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.289255 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.289279 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:10:16.289353 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 11:10:16.289423 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1648,"mutex_wait_us":26,"thread_start_us":102,"threads_started":1}
I20260812 11:10:16.289928 20661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.282790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34742 (local address 127.18.174.195:46209)
0812 11:10:16.283166 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.283178 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.284330 (+ 1152us) server_negotiation.cc:407] Connection header received
0812 11:10:16.284441 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.284446 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.284583 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.284708 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:16.284994 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.285914 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.287384 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.288221 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.288347 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.288448 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.289694 (+ 1246us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.289793 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":164,"threads_started":1}
I20260812 11:10:16.291249 20070 tablet_service.cc:1467] Processing CreateTablet for tablet 71a2cd2702cc4d4d86de80ecdd564dd9 (DEFAULT_TABLE table=test-table [id=7dbb5156d2f64ec6b5e7ebf581b1a4f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:16.291262 20302 tablet_service.cc:1467] Processing CreateTablet for tablet 71a2cd2702cc4d4d86de80ecdd564dd9 (DEFAULT_TABLE table=test-table [id=7dbb5156d2f64ec6b5e7ebf581b1a4f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:16.292404 20070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71a2cd2702cc4d4d86de80ecdd564dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:16.292409 20302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71a2cd2702cc4d4d86de80ecdd564dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:16.292688 20518 tablet_service.cc:1467] Processing CreateTablet for tablet 71a2cd2702cc4d4d86de80ecdd564dd9 (DEFAULT_TABLE table=test-table [id=7dbb5156d2f64ec6b5e7ebf581b1a4f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:16.293670 20518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71a2cd2702cc4d4d86de80ecdd564dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:16.298899 20662 tablet_bootstrap.cc:492] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343: Bootstrap starting.
I20260812 11:10:16.300347 20664 tablet_bootstrap.cc:492] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf: Bootstrap starting.
I20260812 11:10:16.300473 20663 tablet_bootstrap.cc:492] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da: Bootstrap starting.
I20260812 11:10:16.301748 20662 tablet_bootstrap.cc:654] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:16.302289 20663 tablet_bootstrap.cc:654] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:16.302562 20664 tablet_bootstrap.cc:654] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:16.303131 20662 log.cc:824] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:16.303290 20663 log.cc:824] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:16.303737 20664 log.cc:824] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:16.305351 20662 tablet_bootstrap.cc:492] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343: No bootstrap required, opened a new log
I20260812 11:10:16.305459 20663 tablet_bootstrap.cc:492] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da: No bootstrap required, opened a new log
I20260812 11:10:16.305538 20664 tablet_bootstrap.cc:492] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf: No bootstrap required, opened a new log
I20260812 11:10:16.305567 20662 ts_tablet_manager.cc:1397] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 11:10:16.305660 20663 ts_tablet_manager.cc:1397] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 11:10:16.305689 20664 ts_tablet_manager.cc:1397] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:10:16.308633 20662 raft_consensus.cc:348] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a264947f0c40db8bf95d2843b08343" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34751 } } peers { permanent_uuid: "36a5988aa8e4422b977d15a1788cc6da" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37085 } } peers { permanent_uuid: "146513c0fef24f0781d134e6723fb5cf" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46209 } }
I20260812 11:10:16.308882 20662 raft_consensus.cc:374] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:16.308938 20662 raft_consensus.cc:729] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a264947f0c40db8bf95d2843b08343, State: Initialized, Role: FOLLOWER
I20260812 11:10:16.309377 20662 consensus_queue.cc:260] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a264947f0c40db8bf95d2843b08343" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34751 } } peers { permanent_uuid: "36a5988aa8e4422b977d15a1788cc6da" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37085 } } peers { permanent_uuid: "146513c0fef24f0781d134e6723fb5cf" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46209 } }
I20260812 11:10:16.309515 20664 raft_consensus.cc:348] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a264947f0c40db8bf95d2843b08343" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34751 } } peers { permanent_uuid: "36a5988aa8e4422b977d15a1788cc6da" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37085 } } peers { permanent_uuid: "146513c0fef24f0781d134e6723fb5cf" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46209 } }
I20260812 11:10:16.309515 20663 raft_consensus.cc:348] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a264947f0c40db8bf95d2843b08343" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34751 } } peers { permanent_uuid: "36a5988aa8e4422b977d15a1788cc6da" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37085 } } peers { permanent_uuid: "146513c0fef24f0781d134e6723fb5cf" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46209 } }
I20260812 11:10:16.309774 20663 raft_consensus.cc:374] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:16.309774 20664 raft_consensus.cc:374] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:16.309830 20663 raft_consensus.cc:729] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a5988aa8e4422b977d15a1788cc6da, State: Initialized, Role: FOLLOWER
I20260812 11:10:16.309844 20664 raft_consensus.cc:729] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146513c0fef24f0781d134e6723fb5cf, State: Initialized, Role: FOLLOWER
I20260812 11:10:16.310277 20193 heartbeater.cc:503] Master 127.18.174.254:43661 was elected leader, sending a full tablet report...
I20260812 11:10:16.310274 20664 consensus_queue.cc:260] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a264947f0c40db8bf95d2843b08343" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34751 } } peers { permanent_uuid: "36a5988aa8e4422b977d15a1788cc6da" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37085 } } peers { permanent_uuid: "146513c0fef24f0781d134e6723fb5cf" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46209 } }
I20260812 11:10:16.310501 20662 ts_tablet_manager.cc:1428] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 11:10:16.310755 20663 consensus_queue.cc:260] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a264947f0c40db8bf95d2843b08343" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34751 } } peers { permanent_uuid: "36a5988aa8e4422b977d15a1788cc6da" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37085 } } peers { permanent_uuid: "146513c0fef24f0781d134e6723fb5cf" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46209 } }
I20260812 11:10:16.311245 20635 heartbeater.cc:503] Master 127.18.174.254:43661 was elected leader, sending a full tablet report...
I20260812 11:10:16.311254 20664 ts_tablet_manager.cc:1428] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260812 11:10:16.311611 20412 heartbeater.cc:503] Master 127.18.174.254:43661 was elected leader, sending a full tablet report...
I20260812 11:10:16.312942 20663 ts_tablet_manager.cc:1428] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 11:10:16.379941 20674 raft_consensus.cc:482] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:16.380201 20674 raft_consensus.cc:504] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a264947f0c40db8bf95d2843b08343" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34751 } } peers { permanent_uuid: "36a5988aa8e4422b977d15a1788cc6da" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37085 } } peers { permanent_uuid: "146513c0fef24f0781d134e6723fb5cf" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46209 } }
I20260812 11:10:16.381440 20674 leader_election.cc:288] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36a5988aa8e4422b977d15a1788cc6da (127.18.174.194:37085), 146513c0fef24f0781d134e6723fb5cf (127.18.174.195:46209)
I20260812 11:10:16.385912 20661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.381857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:50011 (local address 127.18.174.195:46209)
0812 11:10:16.381989 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.381994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.382309 (+ 315us) server_negotiation.cc:407] Connection header received
0812 11:10:16.382430 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.382433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.382480 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.382565 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:16.382942 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.383670 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.384883 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.385296 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.385414 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.385467 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.385706 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.385785 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:10:16.385911 20659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.381865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:45875 (local address 127.18.174.194:37085)
0812 11:10:16.381989 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.381994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.382226 (+ 232us) server_negotiation.cc:407] Connection header received
0812 11:10:16.382351 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.382386 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.382446 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.382509 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:16.382848 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.383641 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.384898 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.385296 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.385403 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.385461 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.385702 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.385789 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:10:16.385929 20679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.381749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:46209 (local address 127.18.174.193:50011)
0812 11:10:16.382171 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:16.382184 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:16.382320 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:16.382575 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:16.382578 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:16.382621 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:16.382749 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.382755 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.383794 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.383797 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.384747 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.384757 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.385413 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.385417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.385576 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.385603 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 11:10:16.385668 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 11:10:16.385755 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":124,"spinlock_wait_cycles":896,"thread_start_us":114,"threads_started":1}
I20260812 11:10:16.385938 20678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.381749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:37085 (local address 127.18.174.193:45875)
0812 11:10:16.382118 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:16.382131 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:16.382238 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:16.382543 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:16.382547 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:16.382564 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:16.382709 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.382715 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.383814 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.383816 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.384759 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.384769 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.385410 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.385414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.385560 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.385600 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 11:10:16.385666 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 11:10:16.385758 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":89,"spinlock_wait_cycles":10496,"thread_start_us":83,"threads_started":1}
I20260812 11:10:16.386584 20554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71a2cd2702cc4d4d86de80ecdd564dd9" candidate_uuid: "e8a264947f0c40db8bf95d2843b08343" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146513c0fef24f0781d134e6723fb5cf" is_pre_election: true
I20260812 11:10:16.386811 20333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71a2cd2702cc4d4d86de80ecdd564dd9" candidate_uuid: "e8a264947f0c40db8bf95d2843b08343" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a5988aa8e4422b977d15a1788cc6da" is_pre_election: true
I20260812 11:10:16.386971 20554 raft_consensus.cc:2454] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a264947f0c40db8bf95d2843b08343 in term 0.
I20260812 11:10:16.387072 20333 raft_consensus.cc:2454] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8a264947f0c40db8bf95d2843b08343 in term 0.
I20260812 11:10:16.387485 19994 leader_election.cc:302] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 146513c0fef24f0781d134e6723fb5cf, 36a5988aa8e4422b977d15a1788cc6da, e8a264947f0c40db8bf95d2843b08343; no voters:
I20260812 11:10:16.387795 20674 raft_consensus.cc:2781] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:16.387903 20674 raft_consensus.cc:482] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:16.387964 20674 raft_consensus.cc:3037] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:16.389145 20674 raft_consensus.cc:504] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a264947f0c40db8bf95d2843b08343" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34751 } } peers { permanent_uuid: "36a5988aa8e4422b977d15a1788cc6da" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37085 } } peers { permanent_uuid: "146513c0fef24f0781d134e6723fb5cf" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46209 } }
I20260812 11:10:16.389473 20674 leader_election.cc:288] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [CANDIDATE]: Term 1 election: Requested vote from peers 36a5988aa8e4422b977d15a1788cc6da (127.18.174.194:37085), 146513c0fef24f0781d134e6723fb5cf (127.18.174.195:46209)
I20260812 11:10:16.389801 20333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71a2cd2702cc4d4d86de80ecdd564dd9" candidate_uuid: "e8a264947f0c40db8bf95d2843b08343" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a5988aa8e4422b977d15a1788cc6da"
I20260812 11:10:16.389947 20333 raft_consensus.cc:3037] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:16.390990 20333 raft_consensus.cc:2454] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a264947f0c40db8bf95d2843b08343 in term 1.
I20260812 11:10:16.391256 20554 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71a2cd2702cc4d4d86de80ecdd564dd9" candidate_uuid: "e8a264947f0c40db8bf95d2843b08343" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146513c0fef24f0781d134e6723fb5cf"
I20260812 11:10:16.391301 19992 leader_election.cc:302] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a5988aa8e4422b977d15a1788cc6da, e8a264947f0c40db8bf95d2843b08343; no voters:
I20260812 11:10:16.391372 20554 raft_consensus.cc:3037] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:16.391482 20674 raft_consensus.cc:2781] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:16.391709 20674 raft_consensus.cc:686] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [term 1 LEADER]: Becoming Leader. State: Replica: e8a264947f0c40db8bf95d2843b08343, State: Running, Role: LEADER
I20260812 11:10:16.392067 20674 consensus_queue.cc:237] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a264947f0c40db8bf95d2843b08343" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34751 } } peers { permanent_uuid: "36a5988aa8e4422b977d15a1788cc6da" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37085 } } peers { permanent_uuid: "146513c0fef24f0781d134e6723fb5cf" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46209 } }
I20260812 11:10:16.392663 20554 raft_consensus.cc:2454] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8a264947f0c40db8bf95d2843b08343 in term 1.
I20260812 11:10:16.395614 19846 catalog_manager.cc:5495] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8a264947f0c40db8bf95d2843b08343 (127.18.174.193). New cstate: current_term: 1 leader_uuid: "e8a264947f0c40db8bf95d2843b08343" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a264947f0c40db8bf95d2843b08343" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 34751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36a5988aa8e4422b977d15a1788cc6da" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146513c0fef24f0781d134e6723fb5cf" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46209 } health_report { overall_health: UNKNOWN } } }
I20260812 11:10:16.416913 20657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.413102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59684 (local address 127.18.174.193:34751)
0812 11:10:16.413284 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.413288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.413303 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:10:16.413398 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.413400 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.413460 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.413559 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:16.413839 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.414452 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.415377 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.415593 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.415673 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.416020 (+ 347us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:16.416516 (+ 496us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:16.416629 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.416703 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.416747 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 11:10:16.423115 20333 raft_consensus.cc:1261] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da [term 1 FOLLOWER]: Refusing update from remote peer e8a264947f0c40db8bf95d2843b08343: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:16.423888 20680 consensus_queue.cc:1035] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a5988aa8e4422b977d15a1788cc6da" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:16.424001 20554 raft_consensus.cc:1261] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf [term 1 FOLLOWER]: Refusing update from remote peer e8a264947f0c40db8bf95d2843b08343: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:16.424628 20680 consensus_queue.cc:1035] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146513c0fef24f0781d134e6723fb5cf" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 46209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:16.432605 20686 mvcc.cc:205] Tried to move back new op lower bound from 7317639235261251584 to 7317639235145371648. Current Snapshot: MvccSnapshot[applied={T|T < 7317639235261251584}]
I20260812 11:10:16.433319 20688 mvcc.cc:205] Tried to move back new op lower bound from 7317639235261251584 to 7317639235145371648. Current Snapshot: MvccSnapshot[applied={T|T < 7317639235261251584}]
I20260812 11:10:16.443014 19846 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:16.443192 19846 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:16.445817 19846 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 757eab0b84d24ba9ae42007062bd9f51: Sending DeleteTablet for 3 replicas of tablet 71a2cd2702cc4d4d86de80ecdd564dd9
I20260812 11:10:16.446811 20302 tablet_service.cc:1514] Processing DeleteTablet for tablet 71a2cd2702cc4d4d86de80ecdd564dd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:16 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:49782
I20260812 11:10:16.446993 20070 tablet_service.cc:1514] Processing DeleteTablet for tablet 71a2cd2702cc4d4d86de80ecdd564dd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:16 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:59670
I20260812 11:10:16.447441 20518 tablet_service.cc:1514] Processing DeleteTablet for tablet 71a2cd2702cc4d4d86de80ecdd564dd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:16 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:34742
I20260812 11:10:16.447504 20703 tablet_replica.cc:330] T 71a2cd2702cc4d4d86de80ecdd564dd9 P e8a264947f0c40db8bf95d2843b08343: stopping tablet replica
I20260812 11:10:16.447654 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 19961
I20260812 11:10:16.450999 20700 tablet_replica.cc:330] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da: stopping tablet replica
I20260812 11:10:16.451043 20704 tablet_replica.cc:330] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf: stopping tablet replica
I20260812 11:10:16.451378 20704 raft_consensus.cc:2229] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:16.451376 20700 raft_consensus.cc:2229] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:16.451738 20704 raft_consensus.cc:2258] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:16.451762 20700 raft_consensus.cc:2258] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:16.455263 20704 ts_tablet_manager.cc:1905] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:16.455264 20700 ts_tablet_manager.cc:1905] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:16.457638 20704 ts_tablet_manager.cc:1918] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:16.457726 20704 log.cc:1196] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/71a2cd2702cc4d4d86de80ecdd564dd9
I20260812 11:10:16.458055 20704 ts_tablet_manager.cc:1939] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 146513c0fef24f0781d134e6723fb5cf: Deleting consensus metadata
I20260812 11:10:16.458207 20700 ts_tablet_manager.cc:1918] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:16.458299 20700 log.cc:1196] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/71a2cd2702cc4d4d86de80ecdd564dd9
I20260812 11:10:16.458554 20700 ts_tablet_manager.cc:1939] T 71a2cd2702cc4d4d86de80ecdd564dd9 P 36a5988aa8e4422b977d15a1788cc6da: Deleting consensus metadata
I20260812 11:10:16.459434 19831 catalog_manager.cc:4841] TS 146513c0fef24f0781d134e6723fb5cf (127.18.174.195:46209): tablet 71a2cd2702cc4d4d86de80ecdd564dd9 (table test-table [id=7dbb5156d2f64ec6b5e7ebf581b1a4f8]) successfully deleted
I20260812 11:10:16.459529 19820 catalog_manager.cc:4841] TS 36a5988aa8e4422b977d15a1788cc6da (127.18.174.194:37085): tablet 71a2cd2702cc4d4d86de80ecdd564dd9 (table test-table [id=7dbb5156d2f64ec6b5e7ebf581b1a4f8]) successfully deleted
W20260812 11:10:16.463917 19831 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:34751 (error 108)
I20260812 11:10:16.464146 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 20202
I20260812 11:10:16.478111 20658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.476807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:34751 (local address 127.0.0.1:59700)
0812 11:10:16.477883 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:16.477992 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:34751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":948}
W20260812 11:10:16.478420 19831 catalog_manager.cc:4584] TS e8a264947f0c40db8bf95d2843b08343 (127.18.174.193:34751): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 71a2cd2702cc4d4d86de80ecdd564dd9: Network error: Client connection negotiation failed: client connection to 127.18.174.193:34751: connect: Connection refused (error 111)
I20260812 11:10:16.486202 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 20423
I20260812 11:10:16.514129 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 19790
2026-08-12T11:10:16Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2572 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T11:10:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:16Z Disabled control of system clock
I20260812 11:10:16.554981 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:33141
--webserver_interface=127.18.174.254
--webserver_port=0
--builtin_ntp_servers=127.18.174.212:37871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:33141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:10:16.669880 20710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:16.670213 20710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:16.670264 20710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:16.674490 20710 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:16.674578 20710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:16.674597 20710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:16.674616 20710 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:16.674634 20710 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:16.679790 20710 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:37871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:33141
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:33141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:16.681002 20710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:16.682441 20710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:16.691433 20727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:16.691576 20710 server_base.cc:1034] running on GCE node
W20260812 11:10:16.691460 20726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:16.691438 20729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:16.692698 20710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:16.693902 20710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:16.695077 20710 hybrid_clock.cc:648] HybridClock initialized: now 1786533016695060 us; error 32 us; skew 500 ppm
I20260812 11:10:16.697073 20710 webserver.cc:460] Webserver started at http://127.18.174.254:34165/ using document root <none> and password file <none>
I20260812 11:10:16.697664 20710 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:16.697731 20710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:16.697929 20710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:16.700014 20710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "23fbe984b2c142ea803ea874e9c11af3"
format_stamp: "Formatted at 2026-08-12 11:10:16 on dist-test-slave-lgr5"
server_key: "f926405f610852676bc42344e6fd0fc4"
server_key_iv: "c724360371cef3cd3735df9ea95785b4"
server_key_version: "encryptionkey@0"
I20260812 11:10:16.700611 20710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "23fbe984b2c142ea803ea874e9c11af3"
format_stamp: "Formatted at 2026-08-12 11:10:16 on dist-test-slave-lgr5"
server_key: "f926405f610852676bc42344e6fd0fc4"
server_key_iv: "c724360371cef3cd3735df9ea95785b4"
server_key_version: "encryptionkey@0"
I20260812 11:10:16.704420 20710 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:10:16.706835 20736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:16.708046 20710 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:16.708190 20710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "23fbe984b2c142ea803ea874e9c11af3"
format_stamp: "Formatted at 2026-08-12 11:10:16 on dist-test-slave-lgr5"
server_key: "f926405f610852676bc42344e6fd0fc4"
server_key_iv: "c724360371cef3cd3735df9ea95785b4"
server_key_version: "encryptionkey@0"
I20260812 11:10:16.708317 20710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:16.726558 20710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:16.727253 20710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:16.727443 20710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:16.734344 20710 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:33141
I20260812 11:10:16.734386 20829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:33141 every 8 connection(s)
I20260812 11:10:16.735340 20710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:16.739092 20830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:16.741325 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 20710
I20260812 11:10:16.741473 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:16.741794 19131 external_mini_cluster.cc:1428] Setting key d30c6a754b22784d41ee096eccd725ee
I20260812 11:10:16.746150 20830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3: Bootstrap starting.
I20260812 11:10:16.748874 20830 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:16.749827 20830 log.cc:824] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:16.752034 20830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3: No bootstrap required, opened a new log
I20260812 11:10:16.752189 20836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.743459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40778 (local address 127.18.174.254:33141)
0812 11:10:16.744236 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.744255 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.744298 (+ 43us) server_negotiation.cc:407] Connection header received
0812 11:10:16.745153 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.745176 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.745617 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.745924 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:16.746346 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.747343 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.748616 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.749195 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.749337 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.750304 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:16.750309 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:16.750352 (+ 43us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:16.750759 (+ 407us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:16.750821 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:16.750843 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:16.750923 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.751082 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.751402 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":161,"threads_started":1}
I20260812 11:10:16.756064 20830 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23fbe984b2c142ea803ea874e9c11af3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33141 } }
I20260812 11:10:16.756345 20830 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:16.756408 20830 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23fbe984b2c142ea803ea874e9c11af3, State: Initialized, Role: FOLLOWER
I20260812 11:10:16.756847 20830 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23fbe984b2c142ea803ea874e9c11af3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33141 } }
I20260812 11:10:16.756985 20830 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:16.757050 20830 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:16.757146 20830 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:16.758074 20830 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23fbe984b2c142ea803ea874e9c11af3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33141 } }
I20260812 11:10:16.758438 20830 leader_election.cc:302] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23fbe984b2c142ea803ea874e9c11af3; no voters:
I20260812 11:10:16.758811 20830 leader_election.cc:288] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:16.758885 20838 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:16.759092 20838 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [term 1 LEADER]: Becoming Leader. State: Replica: 23fbe984b2c142ea803ea874e9c11af3, State: Running, Role: LEADER
I20260812 11:10:16.759413 20838 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23fbe984b2c142ea803ea874e9c11af3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33141 } }
I20260812 11:10:16.760254 20830 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:16.761245 20843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23fbe984b2c142ea803ea874e9c11af3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23fbe984b2c142ea803ea874e9c11af3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33141 } } }
I20260812 11:10:16.761386 20843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:16.761652 20839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23fbe984b2c142ea803ea874e9c11af3. Latest consensus state: current_term: 1 leader_uuid: "23fbe984b2c142ea803ea874e9c11af3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23fbe984b2c142ea803ea874e9c11af3" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 33141 } } }
I20260812 11:10:16.761745 20839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:16.761874 20858 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:16.765519 20858 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:16.772053 20858 catalog_manager.cc:1347] Generated new cluster ID: c07ebb5aff654fd6868df0d84407a536
I20260812 11:10:16.772179 20858 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:16.791821 20858 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:16.792995 20858 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:16.805037 20858 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3: Generated new TSK 0
I20260812 11:10:16.805860 20858 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:16.808553 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33141
--builtin_ntp_servers=127.18.174.212:37871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:10:16.934648 20875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:16.934926 20875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:16.934965 20875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:16.938977 20875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:16.939036 20875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:16.939092 20875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:10:16.943778 20875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:37871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:16.944919 20875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:16.946264 20875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:16.956283 20891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:16.956300 20886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:16.956283 20888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:16.956523 20875 server_base.cc:1034] running on GCE node
I20260812 11:10:16.957016 20875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:16.957656 20875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:16.958827 20875 hybrid_clock.cc:648] HybridClock initialized: now 1786533016958806 us; error 33 us; skew 500 ppm
I20260812 11:10:16.960829 20875 webserver.cc:460] Webserver started at http://127.18.174.193:37141/ using document root <none> and password file <none>
I20260812 11:10:16.961447 20875 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:16.961510 20875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:16.961726 20875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:16.963896 20875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "0eceed111c4f45b2bbcb856156c5bdfb"
format_stamp: "Formatted at 2026-08-12 11:10:16 on dist-test-slave-lgr5"
server_key: "c0c3b9252468085284270af2d5d56532"
server_key_iv: "1fb8b48d208b084c1089530cd55124bd"
server_key_version: "encryptionkey@0"
I20260812 11:10:16.964484 20875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "0eceed111c4f45b2bbcb856156c5bdfb"
format_stamp: "Formatted at 2026-08-12 11:10:16 on dist-test-slave-lgr5"
server_key: "c0c3b9252468085284270af2d5d56532"
server_key_iv: "1fb8b48d208b084c1089530cd55124bd"
server_key_version: "encryptionkey@0"
I20260812 11:10:16.968168 20875 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:10:16.970634 20899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:16.971930 20875 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:16.972040 20875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "0eceed111c4f45b2bbcb856156c5bdfb"
format_stamp: "Formatted at 2026-08-12 11:10:16 on dist-test-slave-lgr5"
server_key: "c0c3b9252468085284270af2d5d56532"
server_key_iv: "1fb8b48d208b084c1089530cd55124bd"
server_key_version: "encryptionkey@0"
I20260812 11:10:16.972177 20875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:16.982915 20875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:16.983551 20875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:16.983721 20875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:16.984323 20875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:16.985245 20875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:16.985291 20875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:16.985343 20875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:16.985373 20875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:16.993873 20875 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:35549
I20260812 11:10:16.993906 21108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:35549 every 8 connection(s)
I20260812 11:10:16.994732 20875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:16.996675 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 20875
I20260812 11:10:16.996809 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:16.997095 19131 external_mini_cluster.cc:1428] Setting key eae9930f0e422278ae0d20d8ffff4f18
I20260812 11:10:16.998924 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33141
--builtin_ntp_servers=127.18.174.212:37871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:10:17.004570 20836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.996614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:40689 (local address 127.18.174.254:33141)
0812 11:10:16.996771 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.996777 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.997972 (+ 1195us) server_negotiation.cc:407] Connection header received
0812 11:10:16.999383 (+ 1411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.999387 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.999439 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.999520 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:17.000501 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.001042 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.002398 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.002705 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.002812 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.003999 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:17.004004 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:17.004007 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:17.004024 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:17.004050 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:17.004060 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:17.004161 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:17.004322 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 11:10:17.004395 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:10:17.005411 21111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.997070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:33141 (local address 127.18.174.193:40689)
0812 11:10:16.997811 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:16.997874 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:16.999178 (+ 1304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:16.999677 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:16.999684 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:16.999769 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:17.000329 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.000350 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.001158 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.001161 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.002269 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.002280 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.002892 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.002896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.003055 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.003700 (+ 645us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:17.003701 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:17.003744 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:17.003827 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:17.004177 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:17.004186 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:17.004192 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:10:17.004297 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 11:10:17.004542 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":124,"threads_started":1}
I20260812 11:10:17.006697 21109 heartbeater.cc:347] Connected to a master server at 127.18.174.254:33141
I20260812 11:10:17.006974 21109 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:17.007663 21109 heartbeater.cc:511] Master 127.18.174.254:33141 requested a full tablet report, sending...
I20260812 11:10:17.009378 20770 ts_manager.cc:194] Registered new tserver with Master: 0eceed111c4f45b2bbcb856156c5bdfb (127.18.174.193:35549)
I20260812 11:10:17.010528 20770 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.174.193:40689
W20260812 11:10:17.114753 21112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:17.115044 21112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:17.115097 21112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:17.119068 21112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:17.119128 21112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:17.119180 21112 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:10:17.123915 21112 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:37871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:17.125066 21112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:17.126459 21112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:17.135812 21124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:17.135798 21127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:17.135803 21129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:17.136116 21112 server_base.cc:1034] running on GCE node
I20260812 11:10:17.136637 21112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:17.137276 21112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:17.138459 21112 hybrid_clock.cc:648] HybridClock initialized: now 1786533017138440 us; error 30 us; skew 500 ppm
I20260812 11:10:17.140391 21112 webserver.cc:460] Webserver started at http://127.18.174.194:36949/ using document root <none> and password file <none>
I20260812 11:10:17.140977 21112 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:17.141040 21112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:17.141268 21112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:17.143705 21112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "beac1658527d453a942d340aee80e419"
format_stamp: "Formatted at 2026-08-12 11:10:17 on dist-test-slave-lgr5"
server_key: "719e68d2141c81c16610d239d31fcc39"
server_key_iv: "636e2089bed060c7bccff57d2e1d403a"
server_key_version: "encryptionkey@0"
I20260812 11:10:17.144284 21112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "beac1658527d453a942d340aee80e419"
format_stamp: "Formatted at 2026-08-12 11:10:17 on dist-test-slave-lgr5"
server_key: "719e68d2141c81c16610d239d31fcc39"
server_key_iv: "636e2089bed060c7bccff57d2e1d403a"
server_key_version: "encryptionkey@0"
I20260812 11:10:17.148296 21112 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:10:17.151182 21142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:17.152647 21112 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:17.152781 21112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "beac1658527d453a942d340aee80e419"
format_stamp: "Formatted at 2026-08-12 11:10:17 on dist-test-slave-lgr5"
server_key: "719e68d2141c81c16610d239d31fcc39"
server_key_iv: "636e2089bed060c7bccff57d2e1d403a"
server_key_version: "encryptionkey@0"
I20260812 11:10:17.152905 21112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:17.175320 21112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:17.176119 21112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:17.176326 21112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:17.176980 21112 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:17.177999 21112 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:17.178048 21112 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:17.178103 21112 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:17.178131 21112 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:17.186695 21112 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:35549
I20260812 11:10:17.186733 21344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:35549 every 8 connection(s)
I20260812 11:10:17.187635 21112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:17.196779 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 21112
I20260812 11:10:17.196910 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:17.196895 20836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.189508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:53735 (local address 127.18.174.254:33141)
0812 11:10:17.189638 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:17.189642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:17.190732 (+ 1090us) server_negotiation.cc:407] Connection header received
0812 11:10:17.192171 (+ 1439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:17.192175 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:17.192237 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:17.192317 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:17.193264 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.193801 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.194952 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.195185 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.195282 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.196399 (+ 1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:17.196403 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:17.196406 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:17.196421 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:17.196444 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:17.196453 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:17.196513 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:17.196659 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 11:10:17.196728 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:10:17.197230 19131 external_mini_cluster.cc:1428] Setting key 5bb442f83e36abeb4c3af813f935e613
I20260812 11:10:17.197784 21350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.189901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:33141 (local address 127.18.174.194:53735)
0812 11:10:17.190579 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:17.190621 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:17.191926 (+ 1305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:17.192518 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:17.192526 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:17.192616 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:17.193114 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.193127 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.193934 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.193937 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.194822 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.194833 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.195350 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.195354 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.195523 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.196127 (+ 604us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:17.196130 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:17.196177 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:17.196252 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:17.196525 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:17.196534 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:17.196540 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:10:17.196651 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 11:10:17.196940 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":115,"threads_started":1}
I20260812 11:10:17.198902 21345 heartbeater.cc:347] Connected to a master server at 127.18.174.254:33141
I20260812 11:10:17.199131 21345 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:17.199316 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33141
--builtin_ntp_servers=127.18.174.212:37871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:10:17.199656 21345 heartbeater.cc:511] Master 127.18.174.254:33141 requested a full tablet report, sending...
I20260812 11:10:17.200659 20769 ts_manager.cc:194] Registered new tserver with Master: beac1658527d453a942d340aee80e419 (127.18.174.194:35549)
I20260812 11:10:17.201388 20769 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.174.194:53735
W20260812 11:10:17.316617 21353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:17.316903 21353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:17.316946 21353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:17.320959 21353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:17.321023 21353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:17.321084 21353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:10:17.326386 21353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:37871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:33141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:17.327447 21353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:17.328846 21353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:17.338421 21363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:17.338479 21353 server_base.cc:1034] running on GCE node
W20260812 11:10:17.338418 21360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:17.338421 21361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:17.339107 21353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:17.339860 21353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:17.341089 21353 hybrid_clock.cc:648] HybridClock initialized: now 1786533017341055 us; error 52 us; skew 500 ppm
I20260812 11:10:17.343012 21353 webserver.cc:460] Webserver started at http://127.18.174.195:40301/ using document root <none> and password file <none>
I20260812 11:10:17.343605 21353 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:17.343674 21353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:17.343892 21353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:17.346104 21353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "e7eb1a762f8a41b7b59feb7c39cba311"
format_stamp: "Formatted at 2026-08-12 11:10:17 on dist-test-slave-lgr5"
server_key: "a31e584f61dea613399026480531a994"
server_key_iv: "1d707b95a2e0d8d8153e85c76c61d7d8"
server_key_version: "encryptionkey@0"
I20260812 11:10:17.346671 21353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "e7eb1a762f8a41b7b59feb7c39cba311"
format_stamp: "Formatted at 2026-08-12 11:10:17 on dist-test-slave-lgr5"
server_key: "a31e584f61dea613399026480531a994"
server_key_iv: "1d707b95a2e0d8d8153e85c76c61d7d8"
server_key_version: "encryptionkey@0"
I20260812 11:10:17.350490 21353 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 11:10:17.353137 21374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:17.354458 21353 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:17.354563 21353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "e7eb1a762f8a41b7b59feb7c39cba311"
format_stamp: "Formatted at 2026-08-12 11:10:17 on dist-test-slave-lgr5"
server_key: "a31e584f61dea613399026480531a994"
server_key_iv: "1d707b95a2e0d8d8153e85c76c61d7d8"
server_key_version: "encryptionkey@0"
I20260812 11:10:17.354661 21353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:17.367087 21353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:17.367748 21353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:17.367900 21353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:17.368510 21353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:17.369431 21353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:17.369477 21353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:17.369515 21353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:17.369535 21353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:17.378090 21353 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:33271
I20260812 11:10:17.378116 21577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:33271 every 8 connection(s)
I20260812 11:10:17.378960 21353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:17.386703 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 21353
I20260812 11:10:17.386842 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:17.387120 19131 external_mini_cluster.cc:1428] Setting key 893472654bf48c3913ba0c622f1b83be
I20260812 11:10:17.388585 20836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.380822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:45287 (local address 127.18.174.254:33141)
0812 11:10:17.380947 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:17.380951 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:17.382081 (+ 1130us) server_negotiation.cc:407] Connection header received
0812 11:10:17.383507 (+ 1426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:17.383510 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:17.383563 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:17.383650 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:17.384651 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.385182 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.386391 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.386713 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.386826 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.388058 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:17.388060 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:17.388062 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:17.388075 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:17.388139 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:17.388151 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:17.388226 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:17.388384 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 11:10:17.388443 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:10:17.389693 21581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.381189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:33141 (local address 127.18.174.195:45287)
0812 11:10:17.381922 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:17.381966 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:17.383242 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:17.383814 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:17.383822 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:17.383912 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:17.384509 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.384524 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.385305 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.385308 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.386242 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.386253 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.386906 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.386911 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.387085 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.387789 (+ 704us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:17.387791 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:17.387835 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:17.387912 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:17.388238 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:17.388247 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:17.388252 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 11:10:17.388386 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 11:10:17.388690 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":141,"threads_started":1}
I20260812 11:10:17.390751 21579 heartbeater.cc:347] Connected to a master server at 127.18.174.254:33141
I20260812 11:10:17.390974 21579 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:17.391480 21579 heartbeater.cc:511] Master 127.18.174.254:33141 requested a full tablet report, sending...
I20260812 11:10:17.392510 20769 ts_manager.cc:194] Registered new tserver with Master: e7eb1a762f8a41b7b59feb7c39cba311 (127.18.174.195:33271)
I20260812 11:10:17.393081 20769 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.174.195:45287
I20260812 11:10:17.401208 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:10:17.407531 20836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.403421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40780 (local address 127.18.174.254:33141)
0812 11:10:17.403547 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:17.403552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:17.403695 (+ 143us) server_negotiation.cc:407] Connection header received
0812 11:10:17.403816 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:17.403827 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:17.403873 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:17.403938 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:17.404266 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.405035 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.405887 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.406109 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.406195 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.407037 (+ 842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:17.407042 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:17.407044 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:17.407059 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:17.407079 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:17.407087 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:17.407190 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:17.407340 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 11:10:17.407381 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:10:17.410813 20769 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40780:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:10:17.414031 20769 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:17.428819 21596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.422545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:35549 (local address 127.0.0.1:40040)
0812 11:10:17.423769 (+ 1224us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:17.423782 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:17.423860 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:17.424770 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:17.424773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:17.424789 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:17.424882 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.424886 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.425909 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.425912 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.427059 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.427070 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.428151 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.428155 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.428305 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.428366 (+ 61us) client_negotiation.cc:769] Sending connection context
0812 11:10:17.428489 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 11:10:17.428648 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1161,"mutex_wait_us":158,"thread_start_us":100,"threads_started":1}
I20260812 11:10:17.428820 21599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.422727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46222 (local address 127.18.174.195:33271)
0812 11:10:17.423382 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:17.423395 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:17.423422 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:10:17.423503 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:17.423508 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:17.423728 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:17.423906 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:17.424293 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.425526 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.427302 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.428017 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.428160 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.428351 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:17.428533 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 11:10:17.428643 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":101,"threads_started":1}
I20260812 11:10:17.428818 21595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.422402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:33271 (local address 127.0.0.1:46222)
0812 11:10:17.422859 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:17.422906 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:17.423035 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:17.423977 (+ 942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:17.423984 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:17.424005 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:17.424170 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.424179 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.425645 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.425649 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.427181 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.427192 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.428151 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.428155 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.428301 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.428387 (+ 86us) client_negotiation.cc:769] Sending connection context
0812 11:10:17.428489 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 11:10:17.428642 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":137,"thread_start_us":100,"threads_started":1}
I20260812 11:10:17.429421 21602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.423098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40040 (local address 127.18.174.193:35549)
0812 11:10:17.424239 (+ 1141us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:17.424251 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:17.424274 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:10:17.424340 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:17.424343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:17.424487 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:17.424633 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:17.424992 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.425788 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.427182 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.428005 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.428160 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.428351 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:17.429119 (+ 768us) server_negotiation.cc:299] Negotiation successful
0812 11:10:17.429257 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1038,"thread_start_us":105,"threads_started":1}
I20260812 11:10:17.430819 21603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.423154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:35549 (local address 127.0.0.1:54000)
0812 11:10:17.423878 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:17.423892 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:17.424003 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:17.424573 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:17.424576 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:17.424595 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:17.424690 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.424696 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.425942 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.425946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.427180 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.427192 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.430424 (+ 3232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.430427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.430527 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.430550 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:10:17.430612 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 11:10:17.430684 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":50,"thread_start_us":79,"threads_started":1}
I20260812 11:10:17.431068 21604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.423520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54000 (local address 127.18.174.194:35549)
0812 11:10:17.424140 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:17.424152 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:17.424172 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:10:17.424234 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:17.424239 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:17.424429 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:17.424584 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:17.424796 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.425803 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.428427 (+ 2624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.429412 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.430433 (+ 1021us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.430620 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:17.430667 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 11:10:17.430755 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":132,"threads_started":1}
I20260812 11:10:17.432404 21465 tablet_service.cc:1467] Processing CreateTablet for tablet 5035361bb486418ea31343786b31c4b7 (DEFAULT_TABLE table=test-table [id=57d0553eafb04dbbb0690c4be8fa935d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:17.432407 20989 tablet_service.cc:1467] Processing CreateTablet for tablet 5035361bb486418ea31343786b31c4b7 (DEFAULT_TABLE table=test-table [id=57d0553eafb04dbbb0690c4be8fa935d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:17.433624 21465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5035361bb486418ea31343786b31c4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:17.433624 20989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5035361bb486418ea31343786b31c4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:17.441494 21607 tablet_bootstrap.cc:492] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb: Bootstrap starting.
I20260812 11:10:17.441064 21220 tablet_service.cc:1467] Processing CreateTablet for tablet 5035361bb486418ea31343786b31c4b7 (DEFAULT_TABLE table=test-table [id=57d0553eafb04dbbb0690c4be8fa935d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:17.442028 21609 tablet_bootstrap.cc:492] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311: Bootstrap starting.
I20260812 11:10:17.442286 21220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5035361bb486418ea31343786b31c4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:17.444849 21607 tablet_bootstrap.cc:654] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:17.445796 21607 log.cc:824] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:17.446048 21609 tablet_bootstrap.cc:654] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:17.446864 21609 log.cc:824] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:17.448541 21609 tablet_bootstrap.cc:492] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311: No bootstrap required, opened a new log
I20260812 11:10:17.448643 21607 tablet_bootstrap.cc:492] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb: No bootstrap required, opened a new log
I20260812 11:10:17.448735 21609 ts_tablet_manager.cc:1397] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 11:10:17.448849 21607 ts_tablet_manager.cc:1397] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 11:10:17.449924 21616 tablet_bootstrap.cc:492] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419: Bootstrap starting.
I20260812 11:10:17.452443 21616 tablet_bootstrap.cc:654] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:17.452893 21607 raft_consensus.cc:348] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7eb1a762f8a41b7b59feb7c39cba311" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33271 } } peers { permanent_uuid: "0eceed111c4f45b2bbcb856156c5bdfb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35549 } } peers { permanent_uuid: "beac1658527d453a942d340aee80e419" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35549 } }
I20260812 11:10:17.452883 21609 raft_consensus.cc:348] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7eb1a762f8a41b7b59feb7c39cba311" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33271 } } peers { permanent_uuid: "0eceed111c4f45b2bbcb856156c5bdfb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35549 } } peers { permanent_uuid: "beac1658527d453a942d340aee80e419" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35549 } }
I20260812 11:10:17.453145 21607 raft_consensus.cc:374] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:17.453145 21609 raft_consensus.cc:374] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:17.453200 21607 raft_consensus.cc:729] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0eceed111c4f45b2bbcb856156c5bdfb, State: Initialized, Role: FOLLOWER
I20260812 11:10:17.453202 21609 raft_consensus.cc:729] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7eb1a762f8a41b7b59feb7c39cba311, State: Initialized, Role: FOLLOWER
I20260812 11:10:17.453390 21616 log.cc:824] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:17.453663 21607 consensus_queue.cc:260] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7eb1a762f8a41b7b59feb7c39cba311" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33271 } } peers { permanent_uuid: "0eceed111c4f45b2bbcb856156c5bdfb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35549 } } peers { permanent_uuid: "beac1658527d453a942d340aee80e419" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35549 } }
I20260812 11:10:17.453670 21609 consensus_queue.cc:260] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7eb1a762f8a41b7b59feb7c39cba311" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33271 } } peers { permanent_uuid: "0eceed111c4f45b2bbcb856156c5bdfb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35549 } } peers { permanent_uuid: "beac1658527d453a942d340aee80e419" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35549 } }
I20260812 11:10:17.454411 21579 heartbeater.cc:503] Master 127.18.174.254:33141 was elected leader, sending a full tablet report...
I20260812 11:10:17.454617 21109 heartbeater.cc:503] Master 127.18.174.254:33141 was elected leader, sending a full tablet report...
I20260812 11:10:17.454672 21609 ts_tablet_manager.cc:1428] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20260812 11:10:17.455641 21607 ts_tablet_manager.cc:1428] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260812 11:10:17.456720 21616 tablet_bootstrap.cc:492] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419: No bootstrap required, opened a new log
I20260812 11:10:17.456929 21616 ts_tablet_manager.cc:1397] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 11:10:17.461208 21616 raft_consensus.cc:348] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7eb1a762f8a41b7b59feb7c39cba311" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33271 } } peers { permanent_uuid: "0eceed111c4f45b2bbcb856156c5bdfb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35549 } } peers { permanent_uuid: "beac1658527d453a942d340aee80e419" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35549 } }
I20260812 11:10:17.461467 21616 raft_consensus.cc:374] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:17.461500 21616 raft_consensus.cc:729] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: beac1658527d453a942d340aee80e419, State: Initialized, Role: FOLLOWER
I20260812 11:10:17.461884 21616 consensus_queue.cc:260] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7eb1a762f8a41b7b59feb7c39cba311" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33271 } } peers { permanent_uuid: "0eceed111c4f45b2bbcb856156c5bdfb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35549 } } peers { permanent_uuid: "beac1658527d453a942d340aee80e419" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35549 } }
I20260812 11:10:17.462564 21345 heartbeater.cc:503] Master 127.18.174.254:33141 was elected leader, sending a full tablet report...
I20260812 11:10:17.462904 21616 ts_tablet_manager.cc:1428] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260812 11:10:17.495910 21110 tablet.cc:2369] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:17.517194 21619 raft_consensus.cc:482] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:17.517470 21619 raft_consensus.cc:504] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7eb1a762f8a41b7b59feb7c39cba311" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33271 } } peers { permanent_uuid: "0eceed111c4f45b2bbcb856156c5bdfb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35549 } } peers { permanent_uuid: "beac1658527d453a942d340aee80e419" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35549 } }
I20260812 11:10:17.518855 21619 leader_election.cc:288] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7eb1a762f8a41b7b59feb7c39cba311 (127.18.174.195:33271), beac1658527d453a942d340aee80e419 (127.18.174.194:35549)
I20260812 11:10:17.522812 21599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.519263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:59135 (local address 127.18.174.195:33271)
0812 11:10:17.519398 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:17.519403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:17.519743 (+ 340us) server_negotiation.cc:407] Connection header received
0812 11:10:17.519953 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:17.519956 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:17.520002 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:17.520060 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:17.520353 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.520858 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.521920 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.522303 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.522409 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.522463 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:17.522623 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 11:10:17.522691 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:10:17.522832 21625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.519104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:33271 (local address 127.18.174.193:59135)
0812 11:10:17.519653 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:17.519668 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:17.519778 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:17.520105 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:17.520108 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:17.520127 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:17.520242 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.520247 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.520979 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.520983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.521789 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.521798 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.522418 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.522422 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.522517 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.522536 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 11:10:17.522599 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 11:10:17.522677 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":1,"thread_start_us":129,"threads_started":1}
I20260812 11:10:17.522964 21604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.519543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:47323 (local address 127.18.174.194:35549)
0812 11:10:17.519670 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:17.519674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:17.519809 (+ 135us) server_negotiation.cc:407] Connection header received
0812 11:10:17.520202 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:17.520205 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:17.520247 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:17.520312 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:17.520594 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.521076 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.522069 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.522444 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.522550 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.522597 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:17.522764 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 11:10:17.522834 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:10:17.523115 21624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.519116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:35549 (local address 127.18.174.193:47323)
0812 11:10:17.519730 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:17.519746 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:17.519850 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:17.520342 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:17.520345 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:17.520362 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:17.520485 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.520491 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.521185 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.521189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.521949 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:17.521958 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.522554 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.522558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:17.522654 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.522674 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 11:10:17.522737 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 11:10:17.522804 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":107,"threads_started":1}
I20260812 11:10:17.523566 21502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5035361bb486418ea31343786b31c4b7" candidate_uuid: "0eceed111c4f45b2bbcb856156c5bdfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7eb1a762f8a41b7b59feb7c39cba311" is_pre_election: true
I20260812 11:10:17.523720 21259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5035361bb486418ea31343786b31c4b7" candidate_uuid: "0eceed111c4f45b2bbcb856156c5bdfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "beac1658527d453a942d340aee80e419" is_pre_election: true
I20260812 11:10:17.523874 21502 raft_consensus.cc:2454] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0eceed111c4f45b2bbcb856156c5bdfb in term 0.
I20260812 11:10:17.524004 21259 raft_consensus.cc:2454] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0eceed111c4f45b2bbcb856156c5bdfb in term 0.
I20260812 11:10:17.524353 20904 leader_election.cc:302] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0eceed111c4f45b2bbcb856156c5bdfb, e7eb1a762f8a41b7b59feb7c39cba311; no voters:
I20260812 11:10:17.524601 21619 raft_consensus.cc:2781] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:17.524689 21619 raft_consensus.cc:482] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:17.524739 21619 raft_consensus.cc:3037] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:17.525748 21619 raft_consensus.cc:504] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7eb1a762f8a41b7b59feb7c39cba311" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33271 } } peers { permanent_uuid: "0eceed111c4f45b2bbcb856156c5bdfb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35549 } } peers { permanent_uuid: "beac1658527d453a942d340aee80e419" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35549 } }
I20260812 11:10:17.526057 21619 leader_election.cc:288] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [CANDIDATE]: Term 1 election: Requested vote from peers e7eb1a762f8a41b7b59feb7c39cba311 (127.18.174.195:33271), beac1658527d453a942d340aee80e419 (127.18.174.194:35549)
I20260812 11:10:17.526378 21502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5035361bb486418ea31343786b31c4b7" candidate_uuid: "0eceed111c4f45b2bbcb856156c5bdfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7eb1a762f8a41b7b59feb7c39cba311"
I20260812 11:10:17.526400 21259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5035361bb486418ea31343786b31c4b7" candidate_uuid: "0eceed111c4f45b2bbcb856156c5bdfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "beac1658527d453a942d340aee80e419"
I20260812 11:10:17.526489 21259 raft_consensus.cc:3037] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:17.526497 21502 raft_consensus.cc:3037] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:17.527456 21259 raft_consensus.cc:2454] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0eceed111c4f45b2bbcb856156c5bdfb in term 1.
I20260812 11:10:17.527520 21502 raft_consensus.cc:2454] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0eceed111c4f45b2bbcb856156c5bdfb in term 1.
I20260812 11:10:17.527750 20903 leader_election.cc:302] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0eceed111c4f45b2bbcb856156c5bdfb, beac1658527d453a942d340aee80e419; no voters:
I20260812 11:10:17.527913 21619 raft_consensus.cc:2781] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:17.528147 21619 raft_consensus.cc:686] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [term 1 LEADER]: Becoming Leader. State: Replica: 0eceed111c4f45b2bbcb856156c5bdfb, State: Running, Role: LEADER
I20260812 11:10:17.528471 21619 consensus_queue.cc:237] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7eb1a762f8a41b7b59feb7c39cba311" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33271 } } peers { permanent_uuid: "0eceed111c4f45b2bbcb856156c5bdfb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35549 } } peers { permanent_uuid: "beac1658527d453a942d340aee80e419" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35549 } }
I20260812 11:10:17.531491 20769 catalog_manager.cc:5495] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0eceed111c4f45b2bbcb856156c5bdfb (127.18.174.193). New cstate: current_term: 1 leader_uuid: "0eceed111c4f45b2bbcb856156c5bdfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7eb1a762f8a41b7b59feb7c39cba311" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0eceed111c4f45b2bbcb856156c5bdfb" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "beac1658527d453a942d340aee80e419" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35549 } health_report { overall_health: UNKNOWN } } }
I20260812 11:10:17.552320 21602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.548919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40054 (local address 127.18.174.193:35549)
0812 11:10:17.549052 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:17.549056 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:17.549072 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:10:17.549146 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:17.549149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:17.549207 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:17.549306 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:17.549560 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.550084 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.550964 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:17.551181 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:17.551264 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:17.551521 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:17.551939 (+ 418us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:17.552047 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:17.552167 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 11:10:17.552204 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:10:17.558452 21502 raft_consensus.cc:1261] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311 [term 1 FOLLOWER]: Refusing update from remote peer 0eceed111c4f45b2bbcb856156c5bdfb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:17.558452 21259 raft_consensus.cc:1261] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419 [term 1 FOLLOWER]: Refusing update from remote peer 0eceed111c4f45b2bbcb856156c5bdfb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:17.559167 21619 consensus_queue.cc:1035] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "beac1658527d453a942d340aee80e419" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 35549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:17.559360 21626 consensus_queue.cc:1035] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7eb1a762f8a41b7b59feb7c39cba311" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 33271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:17.567749 21634 mvcc.cc:205] Tried to move back new op lower bound from 7317639239911923712 to 7317639239799005184. Current Snapshot: MvccSnapshot[applied={T|T < 7317639239911923712}]
I20260812 11:10:17.575666 20770 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40780:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:17.575879 20770 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40780:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:17.578302 20770 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 23fbe984b2c142ea803ea874e9c11af3: Sending DeleteTablet for 3 replicas of tablet 5035361bb486418ea31343786b31c4b7
I20260812 11:10:17.579136 21465 tablet_service.cc:1514] Processing DeleteTablet for tablet 5035361bb486418ea31343786b31c4b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:17 UTC) from {username='slave'} at 127.0.0.1:46222
I20260812 11:10:17.579276 20989 tablet_service.cc:1514] Processing DeleteTablet for tablet 5035361bb486418ea31343786b31c4b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:17 UTC) from {username='slave'} at 127.0.0.1:40040
I20260812 11:10:17.579288 21220 tablet_service.cc:1514] Processing DeleteTablet for tablet 5035361bb486418ea31343786b31c4b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:17 UTC) from {username='slave'} at 127.0.0.1:54000
I20260812 11:10:17.579764 21649 tablet_replica.cc:330] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb: stopping tablet replica
I20260812 11:10:17.579813 21646 tablet_replica.cc:330] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419: stopping tablet replica
I20260812 11:10:17.580137 21649 raft_consensus.cc:2229] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:10:17.580173 21646 raft_consensus.cc:2229] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:17.580521 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 20875
I20260812 11:10:17.580542 21649 raft_consensus.cc:2258] T 5035361bb486418ea31343786b31c4b7 P 0eceed111c4f45b2bbcb856156c5bdfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:17.580737 21646 raft_consensus.cc:2258] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:17.582346 21646 ts_tablet_manager.cc:1905] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:17.584746 21646 ts_tablet_manager.cc:1918] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:17.584893 21646 log.cc:1196] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/5035361bb486418ea31343786b31c4b7
I20260812 11:10:17.585197 21646 ts_tablet_manager.cc:1939] T 5035361bb486418ea31343786b31c4b7 P beac1658527d453a942d340aee80e419: Deleting consensus metadata
I20260812 11:10:17.587028 20747 catalog_manager.cc:4841] TS beac1658527d453a942d340aee80e419 (127.18.174.194:35549): tablet 5035361bb486418ea31343786b31c4b7 (table test-table [id=57d0553eafb04dbbb0690c4be8fa935d]) successfully deleted
I20260812 11:10:17.588830 21645 tablet_replica.cc:330] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311: stopping tablet replica
I20260812 11:10:17.589154 21645 raft_consensus.cc:2229] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:17.589497 21645 raft_consensus.cc:2258] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:17.591051 21645 ts_tablet_manager.cc:1905] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 11:10:17.593178 20747 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:35549 (error 108)
I20260812 11:10:17.593346 21645 ts_tablet_manager.cc:1918] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:17.593437 21645 log.cc:1196] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/5035361bb486418ea31343786b31c4b7
I20260812 11:10:17.593714 21645 ts_tablet_manager.cc:1939] T 5035361bb486418ea31343786b31c4b7 P e7eb1a762f8a41b7b59feb7c39cba311: Deleting consensus metadata
I20260812 11:10:17.594065 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 21112
I20260812 11:10:17.594229 21595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:17.593919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:35549 (local address 127.0.0.1:40068)
0812 11:10:17.594059 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:17.594139 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:35549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 11:10:17.597362 20748 catalog_manager.cc:4841] TS e7eb1a762f8a41b7b59feb7c39cba311 (127.18.174.195:33271): tablet 5035361bb486418ea31343786b31c4b7 (table test-table [id=57d0553eafb04dbbb0690c4be8fa935d]) successfully deleted
W20260812 11:10:17.600443 20747 catalog_manager.cc:4584] TS 0eceed111c4f45b2bbcb856156c5bdfb (127.18.174.193:35549): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5035361bb486418ea31343786b31c4b7: Network error: Client connection negotiation failed: client connection to 127.18.174.193:35549: connect: Connection refused (error 111)
I20260812 11:10:17.605378 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 21353
I20260812 11:10:17.643079 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 20710
2026-08-12T11:10:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1128 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:17 dist-test-slave-lgr5 krb5kdc[21654](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:17 dist-test-slave-lgr5 krb5kdc[21654](info): set up 2 sockets
Aug 12 11:10:17 dist-test-slave-lgr5 krb5kdc[21654](info): commencing operation
krb5kdc: starting...
W20260812 11:10:19.104919 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.430s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:19 dist-test-slave-lgr5 krb5kdc[21654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:10:19.234717 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:36339
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:40133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:36339
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:19.349851 21681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:19.350145 21681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:19.350188 21681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:19.354220 21681 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:19.354279 21681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:19.354296 21681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:19.354311 21681 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:19.354326 21681 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:19.359714 21681 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:40133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:36339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:36339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:19.360783 21681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:19.361806 21681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:19.370115 21697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:19.370092 21691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:19.370167 21694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:19.370497 21681 server_base.cc:1034] running on GCE node
I20260812 11:10:19.371026 21681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:19.372164 21681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:19.373323 21681 hybrid_clock.cc:648] HybridClock initialized: now 1786533019373294 us; error 43 us; skew 500 ppm
Aug 12 11:10:19 dist-test-slave-lgr5 krb5kdc[21654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533019, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:19.379007 21681 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:10:19.380033 21681 webserver.cc:460] Webserver started at http://127.18.174.254:44565/ using document root <none> and password file <none>
I20260812 11:10:19.380666 21681 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:19.380738 21681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:19.380944 21681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:19.383049 21681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "caf7d786c1f24cd9a30d5936219a05ff"
format_stamp: "Formatted at 2026-08-12 11:10:19 on dist-test-slave-lgr5"
server_key: "150c2666f6e0642799475b817ddb3f2f"
server_key_iv: "5c892a04e42e648b40e329f00477f637"
server_key_version: "encryptionkey@0"
I20260812 11:10:19.383625 21681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "caf7d786c1f24cd9a30d5936219a05ff"
format_stamp: "Formatted at 2026-08-12 11:10:19 on dist-test-slave-lgr5"
server_key: "150c2666f6e0642799475b817ddb3f2f"
server_key_iv: "5c892a04e42e648b40e329f00477f637"
server_key_version: "encryptionkey@0"
I20260812 11:10:19.387503 21681 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:10:19.390076 21710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:19.391412 21681 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:19.391554 21681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "caf7d786c1f24cd9a30d5936219a05ff"
format_stamp: "Formatted at 2026-08-12 11:10:19 on dist-test-slave-lgr5"
server_key: "150c2666f6e0642799475b817ddb3f2f"
server_key_iv: "5c892a04e42e648b40e329f00477f637"
server_key_version: "encryptionkey@0"
I20260812 11:10:19.391661 21681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:19.419375 21681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:19.422847 21681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:19.423054 21681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:19.430428 21681 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:36339
I20260812 11:10:19.430446 21799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:36339 every 8 connection(s)
I20260812 11:10:19.431439 21681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:19.432092 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 21681
I20260812 11:10:19.432230 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:19.432526 19131 external_mini_cluster.cc:1428] Setting key 3f260c4cdcca4e0db36d71ab57f11505
I20260812 11:10:19.434741 21802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:19.441710 21802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff: Bootstrap starting.
Aug 12 11:10:19 dist-test-slave-lgr5 krb5kdc[21654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:19.444541 21802 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:19.445436 21802 log.cc:824] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:19.447883 21802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff: No bootstrap required, opened a new log
I20260812 11:10:19.448045 21808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:19.433981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60570 (local address 127.18.174.254:36339)
0812 11:10:19.434401 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:19.434421 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:19.434467 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:10:19.435329 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:19.435354 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:19.435781 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:19.436176 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:19.436888 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:19.438417 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:19.439292 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:19.439986 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:19.440199 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:19.442725 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:19.442732 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:19.442749 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:19.442793 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:19.444817 (+ 2024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:19.445268 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:19.445275 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:19.445281 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:19.445431 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:19.445748 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:19.445752 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:19.445754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:19.446256 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:19.446446 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:19.446736 (+ 290us) server_negotiation.cc:299] Negotiation successful
0812 11:10:19.447054 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":114,"threads_started":1}
I20260812 11:10:19.451897 21802 raft_consensus.cc:348] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf7d786c1f24cd9a30d5936219a05ff" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36339 } }
I20260812 11:10:19.452414 21802 raft_consensus.cc:374] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:19.452488 21802 raft_consensus.cc:729] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caf7d786c1f24cd9a30d5936219a05ff, State: Initialized, Role: FOLLOWER
I20260812 11:10:19.452893 21802 consensus_queue.cc:260] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf7d786c1f24cd9a30d5936219a05ff" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36339 } }
I20260812 11:10:19.453018 21802 raft_consensus.cc:388] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:19.453065 21802 raft_consensus.cc:482] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:19.453141 21802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:19.454118 21802 raft_consensus.cc:504] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf7d786c1f24cd9a30d5936219a05ff" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36339 } }
I20260812 11:10:19.454444 21802 leader_election.cc:302] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: caf7d786c1f24cd9a30d5936219a05ff; no voters:
I20260812 11:10:19.454733 21802 leader_election.cc:288] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:19.454864 21812 raft_consensus.cc:2781] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:19.455098 21812 raft_consensus.cc:686] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [term 1 LEADER]: Becoming Leader. State: Replica: caf7d786c1f24cd9a30d5936219a05ff, State: Running, Role: LEADER
I20260812 11:10:19.455462 21812 consensus_queue.cc:237] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf7d786c1f24cd9a30d5936219a05ff" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36339 } }
I20260812 11:10:19.456014 21802 sys_catalog.cc:564] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:19.457057 21817 sys_catalog.cc:455] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader caf7d786c1f24cd9a30d5936219a05ff. Latest consensus state: current_term: 1 leader_uuid: "caf7d786c1f24cd9a30d5936219a05ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf7d786c1f24cd9a30d5936219a05ff" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36339 } } }
I20260812 11:10:19.457185 21817 sys_catalog.cc:458] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:19.457532 21816 sys_catalog.cc:455] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "caf7d786c1f24cd9a30d5936219a05ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf7d786c1f24cd9a30d5936219a05ff" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 36339 } } }
I20260812 11:10:19.457597 21829 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:19.457621 21816 sys_catalog.cc:458] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:19.460966 21829 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:19.466714 21829 catalog_manager.cc:1347] Generated new cluster ID: 5a1ff47263bf49f3b7656f9f0bcc9940
I20260812 11:10:19.466776 21829 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:19.476877 21829 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:19.477890 21829 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:19.483162 21829 catalog_manager.cc:5868] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff: Generated new TSK 0
I20260812 11:10:19.483832 21829 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.174.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
Entry for principal kudu/127.18.174.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab.
I20260812 11:10:19.519692 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36339
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:40133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:19.640537 21854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:19.640825 21854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:19.640867 21854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:19.644956 21854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:19.645028 21854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:19.645088 21854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:10:19.650766 21854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:40133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.193.keytab
--principal=kudu/127.18.174.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:19.652043 21854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:19.653263 21854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:19.663957 21869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:19.663972 21865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:19.664152 21854 server_base.cc:1034] running on GCE node
W20260812 11:10:19.664026 21864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:19.664670 21854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:19.665346 21854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:19.666579 21854 hybrid_clock.cc:648] HybridClock initialized: now 1786533019666544 us; error 41 us; skew 500 ppm
Aug 12 11:10:19 dist-test-slave-lgr5 krb5kdc[21654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533019, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:19.669588 21854 init.cc:377] Logged in from keytab as kudu/127.18.174.193@KRBTEST.COM (short username kudu)
I20260812 11:10:19.670475 21854 webserver.cc:460] Webserver started at http://127.18.174.193:38363/ using document root <none> and password file <none>
I20260812 11:10:19.671022 21854 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:19.671078 21854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:19.671250 21854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:19.673439 21854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "28478f0d2b2b46a1aa86a60f20f72a2b"
format_stamp: "Formatted at 2026-08-12 11:10:19 on dist-test-slave-lgr5"
server_key: "82698517f7319c4e813dfa47e8b8dfb7"
server_key_iv: "36755f81933dee2bbcee9722bbff6c72"
server_key_version: "encryptionkey@0"
I20260812 11:10:19.673969 21854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "28478f0d2b2b46a1aa86a60f20f72a2b"
format_stamp: "Formatted at 2026-08-12 11:10:19 on dist-test-slave-lgr5"
server_key: "82698517f7319c4e813dfa47e8b8dfb7"
server_key_iv: "36755f81933dee2bbcee9722bbff6c72"
server_key_version: "encryptionkey@0"
I20260812 11:10:19.677914 21854 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260812 11:10:19.680421 21882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:19.681674 21854 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:19.681792 21854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "28478f0d2b2b46a1aa86a60f20f72a2b"
format_stamp: "Formatted at 2026-08-12 11:10:19 on dist-test-slave-lgr5"
server_key: "82698517f7319c4e813dfa47e8b8dfb7"
server_key_iv: "36755f81933dee2bbcee9722bbff6c72"
server_key_version: "encryptionkey@0"
I20260812 11:10:19.681895 21854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:19.709411 21854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:19.712893 21854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:19.713089 21854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:19.713739 21854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:19.714669 21854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:19.714720 21854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:19.714778 21854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:19.714807 21854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:19.724288 21854 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:35959
I20260812 11:10:19.724324 22084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:35959 every 8 connection(s)
I20260812 11:10:19.725250 21854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:19.727900 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 21854
I20260812 11:10:19.728041 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:19.728415 19131 external_mini_cluster.cc:1428] Setting key a843af3ddd1bb664ab17d06dc292f59d
Aug 12 11:10:19 dist-test-slave-lgr5 krb5kdc[21654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533019, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.193@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.174.194@KRBTEST.COM; defaulting to no policy
I20260812 11:10:19.740154 21808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:19.727155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:37699 (local address 127.18.174.254:36339)
0812 11:10:19.727288 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:19.727330 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:19.728288 (+ 958us) server_negotiation.cc:407] Connection header received
0812 11:10:19.729776 (+ 1488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:19.729779 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:19.729830 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:19.729919 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:19.731430 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:19.732130 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:19.733298 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:19.733639 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:19.733744 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:19.736402 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:19.736405 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:19.736407 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:19.736434 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:19.737874 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:19.738484 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:19.738487 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:19.738488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:19.738567 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:19.738948 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:19.738952 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:19.738953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:19.739147 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:19.739230 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:19.739861 (+ 631us) server_negotiation.cc:299] Negotiation successful
0812 11:10:19.739993 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:10:19.740872 22089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:19.727525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36339 (local address 127.18.174.193:37699)
0812 11:10:19.728132 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:19.728190 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:19.729526 (+ 1336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:19.730096 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:19.730105 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:19.730585 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:19.731260 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:19.731287 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:19.732253 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:19.732256 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:19.733189 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:19.733199 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:19.733798 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:19.733802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:19.733950 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:19.734527 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:19.734544 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:19.736205 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:19.738010 (+ 1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:19.738017 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:19.738035 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:19.738392 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:19.738646 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:19.738649 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:19.738651 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:19.738845 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:19.739246 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:19.739251 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:19.739510 (+ 259us) client_negotiation.cc:769] Sending connection context
0812 11:10:19.739676 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 11:10:19.739981 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":138,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.194@KRBTEST.COM" created.
I20260812 11:10:19.742192 22085 heartbeater.cc:347] Connected to a master server at 127.18.174.254:36339
I20260812 11:10:19.742506 22085 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:19.743110 22085 heartbeater.cc:511] Master 127.18.174.254:36339 requested a full tablet report, sending...
I20260812 11:10:19.745002 21744 ts_manager.cc:194] Registered new tserver with Master: 28478f0d2b2b46a1aa86a60f20f72a2b (127.18.174.193:35959)
I20260812 11:10:19.746579 21744 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.193@KRBTEST.COM'} at 127.18.174.193:37699
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
Entry for principal kudu/127.18.174.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab.
I20260812 11:10:19.758829 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36339
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:40133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:19.875206 22099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:19.875483 22099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:19.875527 22099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:19.879571 22099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:19.879666 22099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:19.879750 22099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:10:19.885373 22099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:40133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.194.keytab
--principal=kudu/127.18.174.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:19.886494 22099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:19.887539 22099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:19.897248 22108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:19.897275 22104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:19.897325 22105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:19.897665 22099 server_base.cc:1034] running on GCE node
I20260812 11:10:19.898104 22099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:19.898772 22099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:19.899935 22099 hybrid_clock.cc:648] HybridClock initialized: now 1786533019899914 us; error 36 us; skew 500 ppm
Aug 12 11:10:19 dist-test-slave-lgr5 krb5kdc[21654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533019, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:19.902804 22099 init.cc:377] Logged in from keytab as kudu/127.18.174.194@KRBTEST.COM (short username kudu)
I20260812 11:10:19.903719 22099 webserver.cc:460] Webserver started at http://127.18.174.194:43451/ using document root <none> and password file <none>
I20260812 11:10:19.904338 22099 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:19.904410 22099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:19.904798 22099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:19.906925 22099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "c18b4a7fd7e14ad09182c737a1d32fcd"
format_stamp: "Formatted at 2026-08-12 11:10:19 on dist-test-slave-lgr5"
server_key: "34ee6c2978c2801a1fa2505d9f8d1c91"
server_key_iv: "6b50ffe5d67485eeb1463cda809d226a"
server_key_version: "encryptionkey@0"
I20260812 11:10:19.907490 22099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "c18b4a7fd7e14ad09182c737a1d32fcd"
format_stamp: "Formatted at 2026-08-12 11:10:19 on dist-test-slave-lgr5"
server_key: "34ee6c2978c2801a1fa2505d9f8d1c91"
server_key_iv: "6b50ffe5d67485eeb1463cda809d226a"
server_key_version: "encryptionkey@0"
I20260812 11:10:19.911279 22099 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:10:19.913920 22130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:19.915206 22099 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:19.915343 22099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "c18b4a7fd7e14ad09182c737a1d32fcd"
format_stamp: "Formatted at 2026-08-12 11:10:19 on dist-test-slave-lgr5"
server_key: "34ee6c2978c2801a1fa2505d9f8d1c91"
server_key_iv: "6b50ffe5d67485eeb1463cda809d226a"
server_key_version: "encryptionkey@0"
I20260812 11:10:19.915444 22099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:19.934327 22099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:19.937525 22099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:19.937712 22099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:19.938315 22099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:19.939162 22099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:19.939209 22099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:19.939265 22099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:19.939291 22099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:19.948309 22099 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:38705
I20260812 11:10:19.948354 22342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:38705 every 8 connection(s)
I20260812 11:10:19.949220 22099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:19.957773 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 22099
I20260812 11:10:19.957940 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:19.958304 19131 external_mini_cluster.cc:1428] Setting key 1ec4460352e8aa3035887a77b5a736bb
Aug 12 11:10:19 dist-test-slave-lgr5 krb5kdc[21654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533019, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.194@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:19.963359 21808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:19.951051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:60267 (local address 127.18.174.254:36339)
0812 11:10:19.951171 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:19.951175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:19.952018 (+ 843us) server_negotiation.cc:407] Connection header received
0812 11:10:19.953354 (+ 1336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:19.953358 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:19.953420 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:19.953492 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:19.954679 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:19.955227 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:19.956452 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:19.956674 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:19.956767 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:19.959572 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:19.959576 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:19.959578 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:19.959608 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:19.961115 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:19.961708 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:19.961712 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:19.961713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:19.961820 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:19.962204 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:19.962206 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:19.962207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:19.962397 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:19.962474 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:19.963115 (+ 641us) server_negotiation.cc:299] Negotiation successful
0812 11:10:19.963221 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:10:19.964335 22348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:19.951400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36339 (local address 127.18.174.194:60267)
0812 11:10:19.951863 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:19.951906 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:19.953139 (+ 1233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:19.953674 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:19.953682 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:19.954030 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:19.954528 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:19.954543 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:19.955352 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:19.955355 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:19.956333 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:19.956344 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:19.956820 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:19.956824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:19.956988 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:19.957581 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:19.957602 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:19.959403 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:19.961235 (+ 1832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:19.961240 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:19.961254 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:19.961610 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:19.961918 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:19.961921 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:19.961923 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:19.962113 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:19.962494 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:19.962501 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:19.962837 (+ 336us) client_negotiation.cc:769] Sending connection context
0812 11:10:19.963079 (+ 242us) client_negotiation.cc:240] Negotiation successful
0812 11:10:19.963441 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":103,"threads_started":1}
I20260812 11:10:19.965499 22345 heartbeater.cc:347] Connected to a master server at 127.18.174.254:36339
I20260812 11:10:19.965781 22345 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:19.966413 22345 heartbeater.cc:511] Master 127.18.174.254:36339 requested a full tablet report, sending...
I20260812 11:10:19.967609 21744 ts_manager.cc:194] Registered new tserver with Master: c18b4a7fd7e14ad09182c737a1d32fcd (127.18.174.194:38705)
I20260812 11:10:19.968235 21744 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.194@KRBTEST.COM'} at 127.18.174.194:60267
WARNING: no policy specified for kudu/127.18.174.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
Entry for principal kudu/127.18.174.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab.
I20260812 11:10:19.989514 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36339
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:40133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:20.102699 22353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:20.102982 22353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:20.103024 22353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:20.107086 22353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:20.107147 22353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:20.107208 22353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:10:20.112885 22353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:40133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.195.keytab
--principal=kudu/127.18.174.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:20.113976 22353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:20.115036 22353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:20.124907 22370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:20.124938 22374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:20.125008 22369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:20.125059 22353 server_base.cc:1034] running on GCE node
I20260812 11:10:20.125581 22353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:20.126264 22353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:20.127439 22353 hybrid_clock.cc:648] HybridClock initialized: now 1786533020127417 us; error 33 us; skew 500 ppm
Aug 12 11:10:20 dist-test-slave-lgr5 krb5kdc[21654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533020, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:20.130268 22353 init.cc:377] Logged in from keytab as kudu/127.18.174.195@KRBTEST.COM (short username kudu)
I20260812 11:10:20.131263 22353 webserver.cc:460] Webserver started at http://127.18.174.195:40299/ using document root <none> and password file <none>
I20260812 11:10:20.131856 22353 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:20.131937 22353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:20.132198 22353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:20.134388 22353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "c51970d714a245f999d4438b2856cf9c"
format_stamp: "Formatted at 2026-08-12 11:10:20 on dist-test-slave-lgr5"
server_key: "9a0c058d4c219eb6a8d49f2aac76bc8a"
server_key_iv: "53791030966190f9fa3cb60b2f63724f"
server_key_version: "encryptionkey@0"
I20260812 11:10:20.134949 22353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "c51970d714a245f999d4438b2856cf9c"
format_stamp: "Formatted at 2026-08-12 11:10:20 on dist-test-slave-lgr5"
server_key: "9a0c058d4c219eb6a8d49f2aac76bc8a"
server_key_iv: "53791030966190f9fa3cb60b2f63724f"
server_key_version: "encryptionkey@0"
I20260812 11:10:20.138943 22353 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 11:10:20.141444 22387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:20.142660 22353 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:10:20.142776 22353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "c51970d714a245f999d4438b2856cf9c"
format_stamp: "Formatted at 2026-08-12 11:10:20 on dist-test-slave-lgr5"
server_key: "9a0c058d4c219eb6a8d49f2aac76bc8a"
server_key_iv: "53791030966190f9fa3cb60b2f63724f"
server_key_version: "encryptionkey@0"
I20260812 11:10:20.142872 22353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:20.166085 22353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:20.169798 22353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:20.170004 22353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:20.170655 22353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:20.171598 22353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:20.171656 22353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:20.171716 22353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:20.171746 22353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:20.181674 22353 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:35091
I20260812 11:10:20.181707 22611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:35091 every 8 connection(s)
I20260812 11:10:20.182634 22353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:20.187022 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 22353
I20260812 11:10:20.187165 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:20.187472 19131 external_mini_cluster.cc:1428] Setting key b0262fa7660bb49c82feb500865c96a0
Aug 12 11:10:20 dist-test-slave-lgr5 krb5kdc[21654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533020, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.195@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:20.196956 21808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.184573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:45411 (local address 127.18.174.254:36339)
0812 11:10:20.184719 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:20.184724 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:20.185564 (+ 840us) server_negotiation.cc:407] Connection header received
0812 11:10:20.186984 (+ 1420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:20.186988 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:20.187056 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:20.187159 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:20.188583 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.189257 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.190600 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.190822 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.190926 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.193578 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:20.193582 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:20.193584 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:20.193611 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:20.194929 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:20.195459 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:20.195462 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:20.195463 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:20.195544 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:20.195867 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:20.195869 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:20.195870 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:20.196066 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:20.196167 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:20.196692 (+ 525us) server_negotiation.cc:299] Negotiation successful
0812 11:10:20.196823 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:10:20.197731 22615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.184944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:36339 (local address 127.18.174.195:45411)
0812 11:10:20.185402 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.185447 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:20.186741 (+ 1294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:20.187375 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:20.187382 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:20.187799 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:20.188430 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:20.188448 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.189411 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.189415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:20.190453 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:20.190465 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.190985 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.190988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:20.191153 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.191789 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:20.191807 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:20.193413 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:20.195064 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:20.195069 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:20.195083 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:20.195348 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:20.195634 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:20.195636 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:20.195637 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:20.195788 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:20.196165 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:20.196171 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:20.196447 (+ 276us) client_negotiation.cc:769] Sending connection context
0812 11:10:20.196610 (+ 163us) client_negotiation.cc:240] Negotiation successful
0812 11:10:20.196879 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":102,"threads_started":1}
I20260812 11:10:20.198948 22612 heartbeater.cc:347] Connected to a master server at 127.18.174.254:36339
I20260812 11:10:20.199199 22612 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:20.199715 22612 heartbeater.cc:511] Master 127.18.174.254:36339 requested a full tablet report, sending...
I20260812 11:10:20.200853 21744 ts_manager.cc:194] Registered new tserver with Master: c51970d714a245f999d4438b2856cf9c (127.18.174.195:35091)
I20260812 11:10:20.201436 21744 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.174.195@KRBTEST.COM'} at 127.18.174.195:45411
I20260812 11:10:20.201800 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:10:20.210577 21808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.203768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40900 (local address 127.18.174.254:36339)
0812 11:10:20.203881 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:20.203884 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:20.204034 (+ 150us) server_negotiation.cc:407] Connection header received
0812 11:10:20.204186 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:20.204188 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:20.204226 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:20.204287 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:20.204929 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.205426 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.206215 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.206451 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.206539 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.207870 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:20.207874 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:20.207876 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:20.207900 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:20.209215 (+ 1315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:20.209586 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:20.209588 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:20.209590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:20.209670 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:20.209862 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:20.209863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:20.209865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:20.210084 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:20.210197 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:20.210342 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 11:10:20.210439 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:10:20.213441 21744 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40900:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:10:20.216483 21744 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:20.231082 22639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.225094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:38705 (local address 127.0.0.1:43760)
0812 11:10:20.226332 (+ 1238us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.226347 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:20.226434 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:20.227199 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:20.227202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:20.227215 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:20.227290 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:20.227307 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.228363 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.228366 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:20.229557 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:20.229567 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.230499 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.230502 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:20.230619 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.230665 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 11:10:20.230786 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 11:10:20.230918 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1165,"mutex_wait_us":3,"thread_start_us":117,"threads_started":1}
I20260812 11:10:20.231091 22644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.225843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43760 (local address 127.18.174.194:38705)
0812 11:10:20.226671 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:20.226681 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:20.226699 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:10:20.226774 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:20.226778 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:20.226934 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:20.227054 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:20.227416 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.228197 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.229678 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.230377 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.230499 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.230639 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:20.230839 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 11:10:20.230949 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":732,"thread_start_us":107,"threads_started":1}
I20260812 11:10:20.231523 22631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.225026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:35091 (local address 127.0.0.1:45728)
0812 11:10:20.225864 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.225919 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:20.226048 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:20.227131 (+ 1083us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:20.227134 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:20.227150 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:20.227269 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:20.227276 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.228630 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.228633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:20.229972 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:20.229978 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.231054 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.231058 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:20.231147 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.231171 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:10:20.231323 (+ 152us) client_negotiation.cc:240] Negotiation successful
0812 11:10:20.231394 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"mutex_wait_us":142,"thread_start_us":79,"threads_started":1}
I20260812 11:10:20.231938 22638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.225155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45728 (local address 127.18.174.195:35091)
0812 11:10:20.226495 (+ 1340us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:20.226506 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:20.226529 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:10:20.226605 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:20.226611 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:20.226826 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:20.226974 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:20.227399 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.228503 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.230102 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.230765 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.230877 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.230995 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:20.231696 (+ 701us) server_negotiation.cc:299] Negotiation successful
0812 11:10:20.231808 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1238,"thread_start_us":175,"threads_started":1}
I20260812 11:10:20.231941 22642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.225837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51932 (local address 127.18.174.193:35959)
0812 11:10:20.226246 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:20.226262 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:20.226505 (+ 243us) server_negotiation.cc:407] Connection header received
0812 11:10:20.226615 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:20.226620 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:20.226789 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:20.226924 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:20.227207 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.228424 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.230100 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.230900 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.231012 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.231128 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:20.231591 (+ 463us) server_negotiation.cc:299] Negotiation successful
0812 11:10:20.231810 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":92,"threads_started":1}
I20260812 11:10:20.232178 22635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.225323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:35959 (local address 127.0.0.1:51932)
0812 11:10:20.226402 (+ 1079us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.226413 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:20.226508 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:20.226930 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:20.226937 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:20.226959 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:20.227104 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:20.227111 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.228579 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.228583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:20.229962 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:20.229974 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.231196 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.231200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:20.231313 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.231336 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:10:20.231399 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 11:10:20.231468 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1023,"mutex_wait_us":78,"thread_start_us":93,"threads_started":1}
I20260812 11:10:20.234355 22229 tablet_service.cc:1467] Processing CreateTablet for tablet fb4cb3dc51ad4942aec41ac97eb697e4 (DEFAULT_TABLE table=test-table [id=1e4afef99454441ea81f30f350baa39b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:20.234877 22480 tablet_service.cc:1467] Processing CreateTablet for tablet fb4cb3dc51ad4942aec41ac97eb697e4 (DEFAULT_TABLE table=test-table [id=1e4afef99454441ea81f30f350baa39b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:20.234872 21965 tablet_service.cc:1467] Processing CreateTablet for tablet fb4cb3dc51ad4942aec41ac97eb697e4 (DEFAULT_TABLE table=test-table [id=1e4afef99454441ea81f30f350baa39b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:20.235337 22229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb4cb3dc51ad4942aec41ac97eb697e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:20.235944 21965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb4cb3dc51ad4942aec41ac97eb697e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:20.235944 22480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb4cb3dc51ad4942aec41ac97eb697e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:20.241623 22645 tablet_bootstrap.cc:492] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd: Bootstrap starting.
I20260812 11:10:20.243037 22646 tablet_bootstrap.cc:492] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b: Bootstrap starting.
I20260812 11:10:20.243683 22647 tablet_bootstrap.cc:492] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c: Bootstrap starting.
I20260812 11:10:20.244069 22645 tablet_bootstrap.cc:654] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:20.245354 22646 tablet_bootstrap.cc:654] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:20.245394 22647 tablet_bootstrap.cc:654] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:20.245401 22645 log.cc:824] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:20.246182 22646 log.cc:824] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:20.246563 22647 log.cc:824] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:20.247731 22645 tablet_bootstrap.cc:492] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd: No bootstrap required, opened a new log
I20260812 11:10:20.247951 22645 ts_tablet_manager.cc:1397] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 11:10:20.248425 22646 tablet_bootstrap.cc:492] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b: No bootstrap required, opened a new log
I20260812 11:10:20.248613 22646 ts_tablet_manager.cc:1397] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260812 11:10:20.248626 22647 tablet_bootstrap.cc:492] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c: No bootstrap required, opened a new log
I20260812 11:10:20.248801 22647 ts_tablet_manager.cc:1397] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:10:20.251621 22647 raft_consensus.cc:348] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51970d714a245f999d4438b2856cf9c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 35091 } } peers { permanent_uuid: "c18b4a7fd7e14ad09182c737a1d32fcd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38705 } } peers { permanent_uuid: "28478f0d2b2b46a1aa86a60f20f72a2b" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35959 } }
I20260812 11:10:20.251856 22647 raft_consensus.cc:374] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:20.251930 22647 raft_consensus.cc:729] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51970d714a245f999d4438b2856cf9c, State: Initialized, Role: FOLLOWER
I20260812 11:10:20.251924 22645 raft_consensus.cc:348] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51970d714a245f999d4438b2856cf9c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 35091 } } peers { permanent_uuid: "c18b4a7fd7e14ad09182c737a1d32fcd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38705 } } peers { permanent_uuid: "28478f0d2b2b46a1aa86a60f20f72a2b" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35959 } }
I20260812 11:10:20.252296 22645 raft_consensus.cc:374] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:20.252365 22645 raft_consensus.cc:729] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18b4a7fd7e14ad09182c737a1d32fcd, State: Initialized, Role: FOLLOWER
I20260812 11:10:20.252444 22647 consensus_queue.cc:260] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51970d714a245f999d4438b2856cf9c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 35091 } } peers { permanent_uuid: "c18b4a7fd7e14ad09182c737a1d32fcd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38705 } } peers { permanent_uuid: "28478f0d2b2b46a1aa86a60f20f72a2b" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35959 } }
I20260812 11:10:20.252866 22645 consensus_queue.cc:260] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51970d714a245f999d4438b2856cf9c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 35091 } } peers { permanent_uuid: "c18b4a7fd7e14ad09182c737a1d32fcd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38705 } } peers { permanent_uuid: "28478f0d2b2b46a1aa86a60f20f72a2b" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35959 } }
I20260812 11:10:20.252772 22646 raft_consensus.cc:348] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51970d714a245f999d4438b2856cf9c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 35091 } } peers { permanent_uuid: "c18b4a7fd7e14ad09182c737a1d32fcd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38705 } } peers { permanent_uuid: "28478f0d2b2b46a1aa86a60f20f72a2b" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35959 } }
I20260812 11:10:20.253018 22646 raft_consensus.cc:374] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:20.253087 22646 raft_consensus.cc:729] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28478f0d2b2b46a1aa86a60f20f72a2b, State: Initialized, Role: FOLLOWER
I20260812 11:10:20.253516 22647 ts_tablet_manager.cc:1428] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 11:10:20.253551 22646 consensus_queue.cc:260] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51970d714a245f999d4438b2856cf9c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 35091 } } peers { permanent_uuid: "c18b4a7fd7e14ad09182c737a1d32fcd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38705 } } peers { permanent_uuid: "28478f0d2b2b46a1aa86a60f20f72a2b" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35959 } }
I20260812 11:10:20.254004 22645 ts_tablet_manager.cc:1428] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 11:10:20.253998 22612 heartbeater.cc:503] Master 127.18.174.254:36339 was elected leader, sending a full tablet report...
I20260812 11:10:20.254357 22345 heartbeater.cc:503] Master 127.18.174.254:36339 was elected leader, sending a full tablet report...
I20260812 11:10:20.254528 22646 ts_tablet_manager.cc:1428] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260812 11:10:20.254837 22085 heartbeater.cc:503] Master 127.18.174.254:36339 was elected leader, sending a full tablet report...
W20260812 11:10:20.433722 22614 tablet.cc:2369] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:10:20.450474 22346 tablet.cc:2369] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:10:20.476599 22087 tablet.cc:2369] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:20.587828 22659 raft_consensus.cc:482] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:20.588074 22659 raft_consensus.cc:504] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51970d714a245f999d4438b2856cf9c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 35091 } } peers { permanent_uuid: "c18b4a7fd7e14ad09182c737a1d32fcd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38705 } } peers { permanent_uuid: "28478f0d2b2b46a1aa86a60f20f72a2b" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35959 } }
I20260812 11:10:20.589305 22659 leader_election.cc:288] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c51970d714a245f999d4438b2856cf9c (127.18.174.195:35091), c18b4a7fd7e14ad09182c737a1d32fcd (127.18.174.194:38705)
I20260812 11:10:20.594789 22644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.589690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:48001 (local address 127.18.174.194:38705)
0812 11:10:20.589837 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:20.589842 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:20.590042 (+ 200us) server_negotiation.cc:407] Connection header received
0812 11:10:20.590246 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:20.590250 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:20.590309 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:20.590408 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:20.590786 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.591600 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.593384 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.593995 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.594130 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.594188 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:20.594571 (+ 383us) server_negotiation.cc:299] Negotiation successful
0812 11:10:20.594650 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:10:20.594789 22638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.589656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:49597 (local address 127.18.174.195:35091)
0812 11:10:20.589942 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:20.589946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:20.590014 (+ 68us) server_negotiation.cc:407] Connection header received
0812 11:10:20.590246 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:20.590250 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:20.590309 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:20.590402 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:20.590788 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.591587 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.593386 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.594013 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.594130 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.594188 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:20.594571 (+ 383us) server_negotiation.cc:299] Negotiation successful
0812 11:10:20.594650 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208}
I20260812 11:10:20.594910 22660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.589564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:35091 (local address 127.18.174.193:49597)
0812 11:10:20.589918 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.589934 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:20.590092 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:20.590418 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:20.590421 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:20.590445 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:20.590667 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:20.590672 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.591709 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.591712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:20.593240 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:20.593249 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.594180 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.594185 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:20.594372 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.594435 (+ 63us) client_negotiation.cc:769] Sending connection context
0812 11:10:20.594522 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 11:10:20.594661 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":175,"spinlock_wait_cycles":32512,"thread_start_us":133,"threads_started":1}
I20260812 11:10:20.594913 22661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.589564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:38705 (local address 127.18.174.193:48001)
0812 11:10:20.589956 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.589968 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:20.590092 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:20.590418 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:20.590421 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:20.590445 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:20.590660 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:20.590668 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.591709 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.591712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:20.593236 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:20.593249 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.594180 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.594185 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:20.594414 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.594435 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 11:10:20.594522 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 11:10:20.594648 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"mutex_wait_us":306,"spinlock_wait_cycles":16768,"thread_start_us":101,"threads_started":1}
I20260812 11:10:20.595685 22526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb4cb3dc51ad4942aec41ac97eb697e4" candidate_uuid: "28478f0d2b2b46a1aa86a60f20f72a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51970d714a245f999d4438b2856cf9c" is_pre_election: true
I20260812 11:10:20.596055 22526 raft_consensus.cc:2454] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28478f0d2b2b46a1aa86a60f20f72a2b in term 0.
I20260812 11:10:20.596164 22259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb4cb3dc51ad4942aec41ac97eb697e4" candidate_uuid: "28478f0d2b2b46a1aa86a60f20f72a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18b4a7fd7e14ad09182c737a1d32fcd" is_pre_election: true
I20260812 11:10:20.596490 22259 raft_consensus.cc:2454] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28478f0d2b2b46a1aa86a60f20f72a2b in term 0.
I20260812 11:10:20.596619 21890 leader_election.cc:302] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28478f0d2b2b46a1aa86a60f20f72a2b, c51970d714a245f999d4438b2856cf9c; no voters:
I20260812 11:10:20.597115 22659 raft_consensus.cc:2781] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:20.597191 22659 raft_consensus.cc:482] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:20.597220 22659 raft_consensus.cc:3037] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:20.598260 22659 raft_consensus.cc:504] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51970d714a245f999d4438b2856cf9c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 35091 } } peers { permanent_uuid: "c18b4a7fd7e14ad09182c737a1d32fcd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38705 } } peers { permanent_uuid: "28478f0d2b2b46a1aa86a60f20f72a2b" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35959 } }
I20260812 11:10:20.598598 22659 leader_election.cc:288] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [CANDIDATE]: Term 1 election: Requested vote from peers c51970d714a245f999d4438b2856cf9c (127.18.174.195:35091), c18b4a7fd7e14ad09182c737a1d32fcd (127.18.174.194:38705)
I20260812 11:10:20.598974 22526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb4cb3dc51ad4942aec41ac97eb697e4" candidate_uuid: "28478f0d2b2b46a1aa86a60f20f72a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c51970d714a245f999d4438b2856cf9c"
I20260812 11:10:20.598974 22259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb4cb3dc51ad4942aec41ac97eb697e4" candidate_uuid: "28478f0d2b2b46a1aa86a60f20f72a2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18b4a7fd7e14ad09182c737a1d32fcd"
I20260812 11:10:20.599098 22259 raft_consensus.cc:3037] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:20.599123 22526 raft_consensus.cc:3037] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:20.600425 22259 raft_consensus.cc:2454] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28478f0d2b2b46a1aa86a60f20f72a2b in term 1.
I20260812 11:10:20.600425 22526 raft_consensus.cc:2454] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28478f0d2b2b46a1aa86a60f20f72a2b in term 1.
I20260812 11:10:20.600834 21887 leader_election.cc:302] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28478f0d2b2b46a1aa86a60f20f72a2b, c18b4a7fd7e14ad09182c737a1d32fcd; no voters:
I20260812 11:10:20.601025 22659 raft_consensus.cc:2781] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:20.601267 22659 raft_consensus.cc:686] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [term 1 LEADER]: Becoming Leader. State: Replica: 28478f0d2b2b46a1aa86a60f20f72a2b, State: Running, Role: LEADER
I20260812 11:10:20.601620 22659 consensus_queue.cc:237] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51970d714a245f999d4438b2856cf9c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 35091 } } peers { permanent_uuid: "c18b4a7fd7e14ad09182c737a1d32fcd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38705 } } peers { permanent_uuid: "28478f0d2b2b46a1aa86a60f20f72a2b" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35959 } }
I20260812 11:10:20.605188 21743 catalog_manager.cc:5495] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b reported cstate change: term changed from 0 to 1, leader changed from <none> to 28478f0d2b2b46a1aa86a60f20f72a2b (127.18.174.193). New cstate: current_term: 1 leader_uuid: "28478f0d2b2b46a1aa86a60f20f72a2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c51970d714a245f999d4438b2856cf9c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 35091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c18b4a7fd7e14ad09182c737a1d32fcd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28478f0d2b2b46a1aa86a60f20f72a2b" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 35959 } health_report { overall_health: HEALTHY } } }
I20260812 11:10:20.683811 22642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.680061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51944 (local address 127.18.174.193:35959)
0812 11:10:20.680219 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:20.680223 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:20.680239 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:10:20.680406 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:20.680409 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:20.680475 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:20.680568 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:20.680848 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.681414 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.682300 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.682519 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.682609 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.682939 (+ 330us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:20.683411 (+ 472us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:20.683526 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:20.683598 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 11:10:20.683663 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:10:20.690366 22259 raft_consensus.cc:1261] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd [term 1 FOLLOWER]: Refusing update from remote peer 28478f0d2b2b46a1aa86a60f20f72a2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:20.690366 22526 raft_consensus.cc:1261] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c [term 1 FOLLOWER]: Refusing update from remote peer 28478f0d2b2b46a1aa86a60f20f72a2b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:20.691118 22662 consensus_queue.cc:1035] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c51970d714a245f999d4438b2856cf9c" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 35091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:20.691314 22659 consensus_queue.cc:1035] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18b4a7fd7e14ad09182c737a1d32fcd" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 38705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:20.699234 22671 mvcc.cc:205] Tried to move back new op lower bound from 7317639252739620864 to 7317639252386750464. Current Snapshot: MvccSnapshot[applied={T|T < 7317639252739620864}]
I20260812 11:10:20.709378 21744 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:20.709558 21744 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:20.712107 21744 catalog_manager.cc:5782] T 00000000000000000000000000000000 P caf7d786c1f24cd9a30d5936219a05ff: Sending DeleteTablet for 3 replicas of tablet fb4cb3dc51ad4942aec41ac97eb697e4
I20260812 11:10:20.713012 21965 tablet_service.cc:1514] Processing DeleteTablet for tablet fb4cb3dc51ad4942aec41ac97eb697e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:20 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:51932
I20260812 11:10:20.712994 22480 tablet_service.cc:1514] Processing DeleteTablet for tablet fb4cb3dc51ad4942aec41ac97eb697e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:20 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:45728
I20260812 11:10:20.713524 22685 tablet_replica.cc:330] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b: stopping tablet replica
I20260812 11:10:20.713555 22229 tablet_service.cc:1514] Processing DeleteTablet for tablet fb4cb3dc51ad4942aec41ac97eb697e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:20 UTC) from {username='kudu', principal='kudu/127.18.174.254@KRBTEST.COM'} at 127.0.0.1:43760
I20260812 11:10:20.713660 22687 tablet_replica.cc:330] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c: stopping tablet replica
I20260812 11:10:20.713919 22685 raft_consensus.cc:2229] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:10:20.713970 22687 raft_consensus.cc:2229] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:20.714358 22687 raft_consensus.cc:2258] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:20.714357 22685 raft_consensus.cc:2258] T fb4cb3dc51ad4942aec41ac97eb697e4 P 28478f0d2b2b46a1aa86a60f20f72a2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:20.714857 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 21854
I20260812 11:10:20.715973 22687 ts_tablet_manager.cc:1905] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:20.718448 22687 ts_tablet_manager.cc:1918] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:20.718466 22688 tablet_replica.cc:330] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd: stopping tablet replica
I20260812 11:10:20.718539 22687 log.cc:1196] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/fb4cb3dc51ad4942aec41ac97eb697e4
I20260812 11:10:20.718806 22688 raft_consensus.cc:2229] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:20.718892 22687 ts_tablet_manager.cc:1939] T fb4cb3dc51ad4942aec41ac97eb697e4 P c51970d714a245f999d4438b2856cf9c: Deleting consensus metadata
I20260812 11:10:20.719185 22688 raft_consensus.cc:2258] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:20.720328 21722 catalog_manager.cc:4841] TS c51970d714a245f999d4438b2856cf9c (127.18.174.195:35091): tablet fb4cb3dc51ad4942aec41ac97eb697e4 (table test-table [id=1e4afef99454441ea81f30f350baa39b]) successfully deleted
I20260812 11:10:20.722287 22688 ts_tablet_manager.cc:1905] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:20.724511 22688 ts_tablet_manager.cc:1918] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:20.724596 22688 log.cc:1196] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/fb4cb3dc51ad4942aec41ac97eb697e4
I20260812 11:10:20.724861 22688 ts_tablet_manager.cc:1939] T fb4cb3dc51ad4942aec41ac97eb697e4 P c18b4a7fd7e14ad09182c737a1d32fcd: Deleting consensus metadata
I20260812 11:10:20.726051 21713 catalog_manager.cc:4841] TS c18b4a7fd7e14ad09182c737a1d32fcd (127.18.174.194:38705): tablet fb4cb3dc51ad4942aec41ac97eb697e4 (table test-table [id=1e4afef99454441ea81f30f350baa39b]) successfully deleted
W20260812 11:10:20.729774 21716 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:35959 (error 108)
I20260812 11:10:20.729975 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 22099
I20260812 11:10:20.758963 22691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.754284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:35959 (local address 127.0.0.1:51958)
0812 11:10:20.758738 (+ 4454us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.758840 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:35959: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4355,"thread_start_us":703,"threads_started":1}
W20260812 11:10:20.759225 21716 catalog_manager.cc:4584] TS 28478f0d2b2b46a1aa86a60f20f72a2b (127.18.174.193:35959): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fb4cb3dc51ad4942aec41ac97eb697e4: Network error: Client connection negotiation failed: client connection to 127.18.174.193:35959: connect: Connection refused (error 111)
I20260812 11:10:20.764402 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 22353
I20260812 11:10:20.773432 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 21681
2026-08-12T11:10:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (3130 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T11:10:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:20Z Disabled control of system clock
I20260812 11:10:20.814193 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:37653
--webserver_interface=127.18.174.254
--webserver_port=0
--builtin_ntp_servers=127.18.174.212:46171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:37653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:10:20.928346 22699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:20.928648 22699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:20.928686 22699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:20.932796 22699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:20.932875 22699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:20.932893 22699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:20.932909 22699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:20.932922 22699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:20.937845 22699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:37653
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:37653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:20.939029 22699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:20.940582 22699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:20.949321 22708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:20.949311 22704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:20.949311 22710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:20.949493 22699 server_base.cc:1034] running on GCE node
I20260812 11:10:20.950201 22699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:20.951385 22699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:20.952571 22699 hybrid_clock.cc:648] HybridClock initialized: now 1786533020952552 us; error 29 us; skew 500 ppm
I20260812 11:10:20.954618 22699 webserver.cc:460] Webserver started at http://127.18.174.254:39789/ using document root <none> and password file <none>
I20260812 11:10:20.955230 22699 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:20.955304 22699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:20.955530 22699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:20.957683 22699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "e6efed4eef6e43e2810df2b3868086ec"
format_stamp: "Formatted at 2026-08-12 11:10:20 on dist-test-slave-lgr5"
server_key: "f666664a22017a06cd63eb1b2caa6beb"
server_key_iv: "7249932a627e777dad8bc1269025aa46"
server_key_version: "encryptionkey@0"
I20260812 11:10:20.958248 22699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "e6efed4eef6e43e2810df2b3868086ec"
format_stamp: "Formatted at 2026-08-12 11:10:20 on dist-test-slave-lgr5"
server_key: "f666664a22017a06cd63eb1b2caa6beb"
server_key_iv: "7249932a627e777dad8bc1269025aa46"
server_key_version: "encryptionkey@0"
I20260812 11:10:20.962085 22699 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:10:20.964669 22722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:20.965976 22699 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:20.966100 22699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "e6efed4eef6e43e2810df2b3868086ec"
format_stamp: "Formatted at 2026-08-12 11:10:20 on dist-test-slave-lgr5"
server_key: "f666664a22017a06cd63eb1b2caa6beb"
server_key_iv: "7249932a627e777dad8bc1269025aa46"
server_key_version: "encryptionkey@0"
I20260812 11:10:20.966200 22699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:20.993522 22699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:20.994302 22699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:20.994488 22699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:21.001727 22699 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:37653
I20260812 11:10:21.001746 22831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:37653 every 8 connection(s)
I20260812 11:10:21.002737 22699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:21.006160 22834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:21.010905 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 22699
I20260812 11:10:21.011036 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:21.011308 19131 external_mini_cluster.cc:1428] Setting key dc4c4c60082b502ce749c131068041c1
I20260812 11:10:21.012012 22834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec: Bootstrap starting.
I20260812 11:10:21.014429 22834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:21.015312 22834 log.cc:824] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:21.017771 22834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec: No bootstrap required, opened a new log
I20260812 11:10:21.021394 22838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.012842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34292 (local address 127.18.174.254:37653)
0812 11:10:21.013506 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:21.013521 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:21.013559 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:10:21.014210 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:21.014229 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:21.014688 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:21.015070 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:21.015474 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.016687 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.017914 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.018437 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.018565 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.019540 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:21.019545 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:21.019559 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:21.019969 (+ 410us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:21.020031 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:21.020051 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:21.020200 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:21.020359 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 11:10:21.020629 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":125,"threads_started":1}
I20260812 11:10:21.021808 22834 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6efed4eef6e43e2810df2b3868086ec" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37653 } }
I20260812 11:10:21.022043 22834 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:21.022097 22834 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6efed4eef6e43e2810df2b3868086ec, State: Initialized, Role: FOLLOWER
I20260812 11:10:21.022528 22834 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6efed4eef6e43e2810df2b3868086ec" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37653 } }
I20260812 11:10:21.022660 22834 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:21.022725 22834 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:21.022819 22834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:21.023800 22834 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6efed4eef6e43e2810df2b3868086ec" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37653 } }
I20260812 11:10:21.024169 22834 leader_election.cc:302] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6efed4eef6e43e2810df2b3868086ec; no voters:
I20260812 11:10:21.024480 22834 leader_election.cc:288] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:21.024605 22843 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:21.024829 22843 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [term 1 LEADER]: Becoming Leader. State: Replica: e6efed4eef6e43e2810df2b3868086ec, State: Running, Role: LEADER
I20260812 11:10:21.025182 22843 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6efed4eef6e43e2810df2b3868086ec" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37653 } }
I20260812 11:10:21.025697 22834 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:21.026798 22845 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6efed4eef6e43e2810df2b3868086ec. Latest consensus state: current_term: 1 leader_uuid: "e6efed4eef6e43e2810df2b3868086ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6efed4eef6e43e2810df2b3868086ec" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37653 } } }
I20260812 11:10:21.026959 22845 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:21.027351 22859 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:21.027676 22844 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6efed4eef6e43e2810df2b3868086ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6efed4eef6e43e2810df2b3868086ec" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 37653 } } }
I20260812 11:10:21.027786 22844 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:21.030700 22859 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:21.036578 22859 catalog_manager.cc:1347] Generated new cluster ID: a3695989ac214f5d819415102275f233
I20260812 11:10:21.036649 22859 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:21.058514 22859 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:21.059474 22859 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:21.064244 22859 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec: Generated new TSK 0
I20260812 11:10:21.065115 22859 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:21.076813 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.193:0
--local_ip_for_outbound_sockets=127.18.174.193
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:37653
--builtin_ntp_servers=127.18.174.212:46171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:10:21.191215 22877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:21.191507 22877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:21.191546 22877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:21.195640 22877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:21.195704 22877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:21.195760 22877 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.193
I20260812 11:10:21.200541 22877 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.174.193
--webserver_port=0
--tserver_master_addrs=127.18.174.254:37653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.193
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:21.201584 22877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:21.202947 22877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:21.212531 22885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:21.212581 22883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:21.212561 22890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:21.212730 22877 server_base.cc:1034] running on GCE node
I20260812 11:10:21.213246 22877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:21.213896 22877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:21.215072 22877 hybrid_clock.cc:648] HybridClock initialized: now 1786533021215050 us; error 34 us; skew 500 ppm
I20260812 11:10:21.217047 22877 webserver.cc:460] Webserver started at http://127.18.174.193:33375/ using document root <none> and password file <none>
I20260812 11:10:21.217635 22877 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:21.217705 22877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:21.217917 22877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:21.220021 22877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/data/instance:
uuid: "cfcfcb113794461896635465da4123c5"
format_stamp: "Formatted at 2026-08-12 11:10:21 on dist-test-slave-lgr5"
server_key: "da69953dcb181138b6adc8217a7fb445"
server_key_iv: "12fdbfee8ec5d0889258852889ced999"
server_key_version: "encryptionkey@0"
I20260812 11:10:21.220625 22877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance:
uuid: "cfcfcb113794461896635465da4123c5"
format_stamp: "Formatted at 2026-08-12 11:10:21 on dist-test-slave-lgr5"
server_key: "da69953dcb181138b6adc8217a7fb445"
server_key_iv: "12fdbfee8ec5d0889258852889ced999"
server_key_version: "encryptionkey@0"
I20260812 11:10:21.224335 22877 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:21.226912 22897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:21.228240 22877 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:21.228356 22877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/wal
uuid: "cfcfcb113794461896635465da4123c5"
format_stamp: "Formatted at 2026-08-12 11:10:21 on dist-test-slave-lgr5"
server_key: "da69953dcb181138b6adc8217a7fb445"
server_key_iv: "12fdbfee8ec5d0889258852889ced999"
server_key_version: "encryptionkey@0"
I20260812 11:10:21.228492 22877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:21.255388 22877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:21.256183 22877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:21.256371 22877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:21.257009 22877 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:21.258015 22877 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:21.258065 22877 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:21.258121 22877 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:21.258148 22877 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:21.266832 22877 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.193:45017
I20260812 11:10:21.266871 23128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.193:45017 every 8 connection(s)
I20260812 11:10:21.267740 22877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:21.274274 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 22877
I20260812 11:10:21.274394 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:21.274689 19131 external_mini_cluster.cc:1428] Setting key f043bf17e1323b129c87e20b50559e6f
I20260812 11:10:21.276947 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.194:0
--local_ip_for_outbound_sockets=127.18.174.194
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:37653
--builtin_ntp_servers=127.18.174.212:46171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:10:21.277386 22838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.269547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.193:57293 (local address 127.18.174.254:37653)
0812 11:10:21.269673 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:21.269677 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:21.270862 (+ 1185us) server_negotiation.cc:407] Connection header received
0812 11:10:21.272314 (+ 1452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:21.272317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:21.272375 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:21.272452 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:21.273371 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.273919 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.275162 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.275468 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.275590 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.276842 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:21.276846 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:21.276848 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:21.276861 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:21.276897 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:21.276904 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:21.276967 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:21.277182 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 11:10:21.277250 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:10:21.278867 23132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.269962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:37653 (local address 127.18.174.193:57293)
0812 11:10:21.270699 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:21.270752 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:21.272066 (+ 1314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:21.272609 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:21.272615 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:21.272699 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:21.273213 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.273228 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.274038 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.274041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.275040 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.275051 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.275623 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.275626 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.275792 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.276512 (+ 720us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:21.276514 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:21.276568 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:21.276651 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:21.276990 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:21.277001 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:21.277008 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 11:10:21.277560 (+ 552us) client_negotiation.cc:240] Negotiation successful
0812 11:10:21.277882 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":119,"threads_started":1}
I20260812 11:10:21.280050 23130 heartbeater.cc:347] Connected to a master server at 127.18.174.254:37653
I20260812 11:10:21.280310 23130 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:21.280827 23130 heartbeater.cc:511] Master 127.18.174.254:37653 requested a full tablet report, sending...
I20260812 11:10:21.282485 22754 ts_manager.cc:194] Registered new tserver with Master: cfcfcb113794461896635465da4123c5 (127.18.174.193:45017)
I20260812 11:10:21.284152 22754 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.174.193:57293
W20260812 11:10:21.392052 23133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:21.392339 23133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:21.392376 23133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:21.396425 23133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:21.396493 23133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:21.396548 23133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.194
I20260812 11:10:21.401307 23133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.174.194
--webserver_port=0
--tserver_master_addrs=127.18.174.254:37653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.194
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:21.402406 23133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:21.403833 23133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:21.413813 23145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:21.413828 23144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:21.413830 23148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:21.414027 23133 server_base.cc:1034] running on GCE node
I20260812 11:10:21.414618 23133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:21.415263 23133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:21.416421 23133 hybrid_clock.cc:648] HybridClock initialized: now 1786533021416398 us; error 35 us; skew 500 ppm
I20260812 11:10:21.418545 23133 webserver.cc:460] Webserver started at http://127.18.174.194:34927/ using document root <none> and password file <none>
I20260812 11:10:21.419323 23133 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:21.419445 23133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:21.419719 23133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:21.422227 23133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/data/instance:
uuid: "021abc98a7854b27a223340267f68a7b"
format_stamp: "Formatted at 2026-08-12 11:10:21 on dist-test-slave-lgr5"
server_key: "3ac2ba0c46c0d1086332b29c40475c4e"
server_key_iv: "f9e1de41785b321de4877344fa2e9137"
server_key_version: "encryptionkey@0"
I20260812 11:10:21.422784 23133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance:
uuid: "021abc98a7854b27a223340267f68a7b"
format_stamp: "Formatted at 2026-08-12 11:10:21 on dist-test-slave-lgr5"
server_key: "3ac2ba0c46c0d1086332b29c40475c4e"
server_key_iv: "f9e1de41785b321de4877344fa2e9137"
server_key_version: "encryptionkey@0"
I20260812 11:10:21.426885 23133 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:10:21.429584 23161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:21.430842 23133 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:10:21.430953 23133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/wal
uuid: "021abc98a7854b27a223340267f68a7b"
format_stamp: "Formatted at 2026-08-12 11:10:21 on dist-test-slave-lgr5"
server_key: "3ac2ba0c46c0d1086332b29c40475c4e"
server_key_iv: "f9e1de41785b321de4877344fa2e9137"
server_key_version: "encryptionkey@0"
I20260812 11:10:21.431053 23133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:21.444299 23133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:21.444972 23133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:21.445123 23133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:21.445676 23133 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:21.446600 23133 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:21.446650 23133 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:21.446691 23133 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:21.446703 23133 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:21.455415 23133 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.194:37445
I20260812 11:10:21.455438 23404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.194:37445 every 8 connection(s)
I20260812 11:10:21.456352 23133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:21.464830 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 23133
I20260812 11:10:21.464956 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:21.465260 19131 external_mini_cluster.cc:1428] Setting key 10e890266ceafb22491898b66a6d7664
I20260812 11:10:21.465704 22838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.458171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.194:53659 (local address 127.18.174.254:37653)
0812 11:10:21.458298 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:21.458302 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:21.459386 (+ 1084us) server_negotiation.cc:407] Connection header received
0812 11:10:21.460843 (+ 1457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:21.460847 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:21.460909 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:21.460986 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:21.461900 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.462431 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.463575 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.463802 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.463893 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.465191 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:21.465194 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:21.465196 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:21.465211 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:21.465231 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:21.465239 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:21.465300 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:21.465484 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 11:10:21.465555 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:10:21.466584 23413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.458562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:37653 (local address 127.18.174.194:53659)
0812 11:10:21.459216 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:21.459256 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:21.460626 (+ 1370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:21.461174 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:21.461182 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:21.461265 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:21.461757 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.461770 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.462561 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.462564 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.463451 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.463461 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.463958 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.463963 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.464179 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.464883 (+ 704us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:21.464885 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:21.464953 (+ 68us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:21.465043 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:21.465312 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:21.465321 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:21.465327 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:10:21.465458 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 11:10:21.465766 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":101,"threads_started":1}
I20260812 11:10:21.467334 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.174.195:0
--local_ip_for_outbound_sockets=127.18.174.195
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:37653
--builtin_ntp_servers=127.18.174.212:46171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:10:21.467767 23411 heartbeater.cc:347] Connected to a master server at 127.18.174.254:37653
I20260812 11:10:21.468015 23411 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:21.468581 23411 heartbeater.cc:511] Master 127.18.174.254:37653 requested a full tablet report, sending...
I20260812 11:10:21.469646 22754 ts_manager.cc:194] Registered new tserver with Master: 021abc98a7854b27a223340267f68a7b (127.18.174.194:37445)
I20260812 11:10:21.470242 22754 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.174.194:53659
W20260812 11:10:21.583477 23414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:21.583797 23414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:21.583853 23414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:21.588168 23414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:21.588248 23414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:21.588327 23414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.174.195
I20260812 11:10:21.593349 23414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:46171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.174.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.174.195
--webserver_port=0
--tserver_master_addrs=127.18.174.254:37653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.174.195
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:21.594554 23414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:21.596014 23414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:10:21.606374 23414 server_base.cc:1034] running on GCE node
W20260812 11:10:21.606314 23428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:21.606309 23431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:21.606313 23424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:21.606983 23414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:21.607622 23414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:21.608786 23414 hybrid_clock.cc:648] HybridClock initialized: now 1786533021608751 us; error 46 us; skew 500 ppm
I20260812 11:10:21.610826 23414 webserver.cc:460] Webserver started at http://127.18.174.195:40289/ using document root <none> and password file <none>
I20260812 11:10:21.611480 23414 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:21.611552 23414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:21.611764 23414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:21.614110 23414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/data/instance:
uuid: "446a64fe32e34ad2a8aaab60e52bd491"
format_stamp: "Formatted at 2026-08-12 11:10:21 on dist-test-slave-lgr5"
server_key: "d85ba1ad1448efe82c652a95e6fd1e2a"
server_key_iv: "f249aba6b9cdf1856786d50fb6f9f959"
server_key_version: "encryptionkey@0"
I20260812 11:10:21.614696 23414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance:
uuid: "446a64fe32e34ad2a8aaab60e52bd491"
format_stamp: "Formatted at 2026-08-12 11:10:21 on dist-test-slave-lgr5"
server_key: "d85ba1ad1448efe82c652a95e6fd1e2a"
server_key_iv: "f249aba6b9cdf1856786d50fb6f9f959"
server_key_version: "encryptionkey@0"
I20260812 11:10:21.618733 23414 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:10:21.621495 23449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:21.622912 23414 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:10:21.623040 23414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/wal
uuid: "446a64fe32e34ad2a8aaab60e52bd491"
format_stamp: "Formatted at 2026-08-12 11:10:21 on dist-test-slave-lgr5"
server_key: "d85ba1ad1448efe82c652a95e6fd1e2a"
server_key_iv: "f249aba6b9cdf1856786d50fb6f9f959"
server_key_version: "encryptionkey@0"
I20260812 11:10:21.623167 23414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:21.659793 23414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:21.660779 23414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:21.661017 23414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:21.661672 23414 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:21.662657 23414 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:21.662715 23414 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:21.662757 23414 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:21.662777 23414 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:21.671499 23414 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.195:37223
I20260812 11:10:21.671533 23660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.195:37223 every 8 connection(s)
I20260812 11:10:21.672480 23414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:21.675139 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 23414
I20260812 11:10:21.675249 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:21.675558 19131 external_mini_cluster.cc:1428] Setting key f2718b873e62c5c2064f00bfccd73400
I20260812 11:10:21.681890 22838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.674348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:39263 (local address 127.18.174.254:37653)
0812 11:10:21.674481 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:21.674485 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:21.675662 (+ 1177us) server_negotiation.cc:407] Connection header received
0812 11:10:21.677417 (+ 1755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:21.677419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:21.677467 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:21.677532 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:21.678499 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.679034 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.680142 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.680376 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.680457 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.681491 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:21.681495 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:21.681497 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:21.681514 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:21.681534 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:21.681542 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:21.681606 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:21.681718 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 11:10:21.681772 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:10:21.682721 23665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.674767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:37653 (local address 127.18.174.195:39263)
0812 11:10:21.675503 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:21.675556 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:21.677199 (+ 1643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:21.677722 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:21.677732 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:21.677844 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:21.678357 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.678371 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.679130 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.679133 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.680003 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.680012 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.680498 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.680501 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.680644 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.681223 (+ 579us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:21.681225 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:21.681267 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:21.681332 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:21.681611 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:21.681615 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:21.681619 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:10:21.681708 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 11:10:21.681944 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":114,"threads_started":1}
I20260812 11:10:21.683799 23662 heartbeater.cc:347] Connected to a master server at 127.18.174.254:37653
I20260812 11:10:21.684033 23662 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:21.684633 23662 heartbeater.cc:511] Master 127.18.174.254:37653 requested a full tablet report, sending...
I20260812 11:10:21.685709 22754 ts_manager.cc:194] Registered new tserver with Master: 446a64fe32e34ad2a8aaab60e52bd491 (127.18.174.195:37223)
I20260812 11:10:21.686429 22754 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.174.195:39263
I20260812 11:10:21.689841 19131 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:10:21.695500 22838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.691798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34308 (local address 127.18.174.254:37653)
0812 11:10:21.691910 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:21.691913 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:21.692103 (+ 190us) server_negotiation.cc:407] Connection header received
0812 11:10:21.692215 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:21.692217 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:21.692255 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:21.692333 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:21.692540 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.693044 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.693961 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.694187 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.694277 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.695084 (+ 807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:21.695087 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:21.695090 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:21.695102 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:21.695124 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:21.695131 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:21.695187 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:21.695311 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 11:10:21.695366 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:10:21.698387 22754 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34308:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:10:21.701568 22754 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:21.716467 23702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.711533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38468 (local address 127.18.174.193:45017)
0812 11:10:21.711878 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:21.711890 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:21.711910 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:10:21.711994 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:21.711999 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:21.712239 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:21.712410 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:21.712590 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.713335 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.715171 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.715734 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.715850 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.716056 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:21.716192 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 11:10:21.716298 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":103,"threads_started":1}
I20260812 11:10:21.716562 23695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.710565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.195:37223 (local address 127.0.0.1:47150)
0812 11:10:21.711030 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:21.711043 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:21.711124 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:21.712482 (+ 1358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:21.712485 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:21.712505 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:21.712601 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.712607 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.713997 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.714000 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.715070 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.715080 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.716127 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.716131 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.716239 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.716263 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:10:21.716314 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 11:10:21.716385 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":93,"thread_start_us":106,"threads_started":1}
I20260812 11:10:21.716811 23690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.710159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:37445 (local address 127.0.0.1:44968)
0812 11:10:21.710574 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:21.710647 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:21.710793 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:21.711991 (+ 1198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:21.711997 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:21.712023 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:21.712207 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.712215 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.713656 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.713659 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.715042 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.715049 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.716127 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.716131 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.716529 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.716553 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:10:21.716620 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 11:10:21.716688 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":374,"thread_start_us":104,"threads_started":1}
I20260812 11:10:21.716462 23698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.710949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:45017 (local address 127.0.0.1:38468)
0812 11:10:21.711200 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:21.711213 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:21.711303 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:21.712383 (+ 1080us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:21.712385 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:21.712403 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:21.712498 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.712504 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.713448 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.713451 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.715025 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.715037 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.715854 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.715858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.715981 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.716023 (+ 42us) client_negotiation.cc:769] Sending connection context
0812 11:10:21.716159 (+ 136us) client_negotiation.cc:240] Negotiation successful
0812 11:10:21.716298 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":108,"thread_start_us":92,"threads_started":1}
I20260812 11:10:21.717404 23699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.711100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47150 (local address 127.18.174.195:37223)
0812 11:10:21.711998 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:21.712010 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:21.712031 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:10:21.712129 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:21.712134 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:21.712321 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:21.712746 (+ 425us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:21.712896 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.713870 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.715202 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.715961 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.716902 (+ 941us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.717097 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:21.717152 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 11:10:21.717247 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":796,"thread_start_us":152,"threads_started":1}
I20260812 11:10:21.717572 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.710307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44968 (local address 127.18.174.194:37445)
0812 11:10:21.711470 (+ 1163us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:21.711482 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:21.711509 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:10:21.711590 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:21.711596 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:21.711826 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:21.711996 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:21.712330 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.713541 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.715156 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.715961 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.716194 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.716389 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:21.717319 (+ 930us) server_negotiation.cc:299] Negotiation successful
0812 11:10:21.717429 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1048,"thread_start_us":141,"threads_started":1}
I20260812 11:10:21.720110 22996 tablet_service.cc:1467] Processing CreateTablet for tablet 000539a007854822a291b896a34d1fd4 (DEFAULT_TABLE table=test-table [id=308f823f56fb4f3e9d7316549871ab6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:21.720221 23261 tablet_service.cc:1467] Processing CreateTablet for tablet 000539a007854822a291b896a34d1fd4 (DEFAULT_TABLE table=test-table [id=308f823f56fb4f3e9d7316549871ab6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:21.720222 23551 tablet_service.cc:1467] Processing CreateTablet for tablet 000539a007854822a291b896a34d1fd4 (DEFAULT_TABLE table=test-table [id=308f823f56fb4f3e9d7316549871ab6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:21.721340 23551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 000539a007854822a291b896a34d1fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:21.721340 23261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 000539a007854822a291b896a34d1fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:21.721342 22996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 000539a007854822a291b896a34d1fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:21.728202 23703 tablet_bootstrap.cc:492] T 000539a007854822a291b896a34d1fd4 P cfcfcb113794461896635465da4123c5: Bootstrap starting.
I20260812 11:10:21.729328 23708 tablet_bootstrap.cc:492] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491: Bootstrap starting.
I20260812 11:10:21.730477 23703 tablet_bootstrap.cc:654] T 000539a007854822a291b896a34d1fd4 P cfcfcb113794461896635465da4123c5: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:21.731132 23708 tablet_bootstrap.cc:654] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:21.731240 23703 log.cc:824] T 000539a007854822a291b896a34d1fd4 P cfcfcb113794461896635465da4123c5: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:21.731889 23708 log.cc:824] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:21.732038 23707 tablet_bootstrap.cc:492] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b: Bootstrap starting.
I20260812 11:10:21.733757 23703 tablet_bootstrap.cc:492] T 000539a007854822a291b896a34d1fd4 P cfcfcb113794461896635465da4123c5: No bootstrap required, opened a new log
I20260812 11:10:21.733858 23708 tablet_bootstrap.cc:492] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491: No bootstrap required, opened a new log
I20260812 11:10:21.733975 23703 ts_tablet_manager.cc:1397] T 000539a007854822a291b896a34d1fd4 P cfcfcb113794461896635465da4123c5: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 11:10:21.734032 23708 ts_tablet_manager.cc:1397] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 11:10:21.734150 23707 tablet_bootstrap.cc:654] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:21.734900 23707 log.cc:824] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:21.736696 23707 tablet_bootstrap.cc:492] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b: No bootstrap required, opened a new log
I20260812 11:10:21.736874 23707 ts_tablet_manager.cc:1397] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:10:21.738349 23703 raft_consensus.cc:348] T 000539a007854822a291b896a34d1fd4 P cfcfcb113794461896635465da4123c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021abc98a7854b27a223340267f68a7b" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37445 } } peers { permanent_uuid: "cfcfcb113794461896635465da4123c5" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45017 } } peers { permanent_uuid: "446a64fe32e34ad2a8aaab60e52bd491" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37223 } }
I20260812 11:10:21.738349 23708 raft_consensus.cc:348] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021abc98a7854b27a223340267f68a7b" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37445 } } peers { permanent_uuid: "cfcfcb113794461896635465da4123c5" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45017 } } peers { permanent_uuid: "446a64fe32e34ad2a8aaab60e52bd491" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37223 } }
I20260812 11:10:21.738634 23708 raft_consensus.cc:374] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:21.738634 23703 raft_consensus.cc:374] T 000539a007854822a291b896a34d1fd4 P cfcfcb113794461896635465da4123c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:21.738693 23708 raft_consensus.cc:729] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 446a64fe32e34ad2a8aaab60e52bd491, State: Initialized, Role: FOLLOWER
I20260812 11:10:21.738693 23703 raft_consensus.cc:729] T 000539a007854822a291b896a34d1fd4 P cfcfcb113794461896635465da4123c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcfcb113794461896635465da4123c5, State: Initialized, Role: FOLLOWER
I20260812 11:10:21.739223 23708 consensus_queue.cc:260] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021abc98a7854b27a223340267f68a7b" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37445 } } peers { permanent_uuid: "cfcfcb113794461896635465da4123c5" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45017 } } peers { permanent_uuid: "446a64fe32e34ad2a8aaab60e52bd491" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37223 } }
I20260812 11:10:21.739223 23703 consensus_queue.cc:260] T 000539a007854822a291b896a34d1fd4 P cfcfcb113794461896635465da4123c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021abc98a7854b27a223340267f68a7b" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37445 } } peers { permanent_uuid: "cfcfcb113794461896635465da4123c5" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45017 } } peers { permanent_uuid: "446a64fe32e34ad2a8aaab60e52bd491" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37223 } }
I20260812 11:10:21.740288 23703 ts_tablet_manager.cc:1428] T 000539a007854822a291b896a34d1fd4 P cfcfcb113794461896635465da4123c5: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260812 11:10:21.740288 23708 ts_tablet_manager.cc:1428] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491: Time spent starting tablet: real 0.006s user 0.002s sys 0.005s
I20260812 11:10:21.740586 23662 heartbeater.cc:503] Master 127.18.174.254:37653 was elected leader, sending a full tablet report...
I20260812 11:10:21.740643 23130 heartbeater.cc:503] Master 127.18.174.254:37653 was elected leader, sending a full tablet report...
I20260812 11:10:21.740592 23707 raft_consensus.cc:348] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021abc98a7854b27a223340267f68a7b" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37445 } } peers { permanent_uuid: "cfcfcb113794461896635465da4123c5" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45017 } } peers { permanent_uuid: "446a64fe32e34ad2a8aaab60e52bd491" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37223 } }
I20260812 11:10:21.740852 23707 raft_consensus.cc:374] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:21.740904 23707 raft_consensus.cc:729] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 021abc98a7854b27a223340267f68a7b, State: Initialized, Role: FOLLOWER
I20260812 11:10:21.741323 23707 consensus_queue.cc:260] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021abc98a7854b27a223340267f68a7b" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37445 } } peers { permanent_uuid: "cfcfcb113794461896635465da4123c5" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45017 } } peers { permanent_uuid: "446a64fe32e34ad2a8aaab60e52bd491" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37223 } }
I20260812 11:10:21.742349 23707 ts_tablet_manager.cc:1428] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260812 11:10:21.742676 23411 heartbeater.cc:503] Master 127.18.174.254:37653 was elected leader, sending a full tablet report...
W20260812 11:10:21.768970 23131 tablet.cc:2369] T 000539a007854822a291b896a34d1fd4 P cfcfcb113794461896635465da4123c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:21.833688 23716 raft_consensus.cc:482] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:21.833912 23716 raft_consensus.cc:504] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021abc98a7854b27a223340267f68a7b" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37445 } } peers { permanent_uuid: "cfcfcb113794461896635465da4123c5" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45017 } } peers { permanent_uuid: "446a64fe32e34ad2a8aaab60e52bd491" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37223 } }
I20260812 11:10:21.835162 23716 leader_election.cc:288] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 021abc98a7854b27a223340267f68a7b (127.18.174.194:37445), cfcfcb113794461896635465da4123c5 (127.18.174.193:45017)
I20260812 11:10:21.840051 23702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.835877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:48919 (local address 127.18.174.193:45017)
0812 11:10:21.836014 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:21.836018 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:21.836145 (+ 127us) server_negotiation.cc:407] Connection header received
0812 11:10:21.836282 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:21.836285 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:21.836325 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:21.836398 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:21.836638 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.837329 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.838745 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.839382 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.839506 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.839560 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:21.839839 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 11:10:21.839915 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 11:10:21.840051 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.835547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.174.195:45739 (local address 127.18.174.194:37445)
0812 11:10:21.835668 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:21.835672 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:21.835692 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:10:21.835932 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:21.835935 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:21.835995 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:21.836062 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:21.836426 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.837175 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.838745 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.839376 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.839506 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.839560 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:21.839839 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 11:10:21.839928 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 11:10:21.840093 23665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.835435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.194:37445 (local address 127.18.174.195:45739)
0812 11:10:21.835611 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:21.835635 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:21.835774 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:21.836133 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:21.836136 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:21.836180 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:21.836308 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.836323 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.837287 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.837289 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.838591 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.838604 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.839527 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.839530 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.839702 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.839740 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 11:10:21.839817 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 11:10:21.839908 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":36,"spinlock_wait_cycles":3328}
I20260812 11:10:21.840101 23722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.835733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:45017 (local address 127.18.174.195:48919)
0812 11:10:21.836039 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:21.836052 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:21.836187 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:21.836417 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:21.836420 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:21.836439 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:21.836535 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.836539 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.837423 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.837426 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.838597 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:21.838603 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.839522 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.839527 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:21.839708 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.839736 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 11:10:21.839825 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 11:10:21.839905 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":100,"spinlock_wait_cycles":41856,"thread_start_us":139,"threads_started":1}
I20260812 11:10:21.841020 23301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "000539a007854822a291b896a34d1fd4" candidate_uuid: "446a64fe32e34ad2a8aaab60e52bd491" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021abc98a7854b27a223340267f68a7b" is_pre_election: true
I20260812 11:10:21.841015 23041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "000539a007854822a291b896a34d1fd4" candidate_uuid: "446a64fe32e34ad2a8aaab60e52bd491" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfcb113794461896635465da4123c5" is_pre_election: true
I20260812 11:10:21.841372 23301 raft_consensus.cc:2454] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446a64fe32e34ad2a8aaab60e52bd491 in term 0.
I20260812 11:10:21.841372 23041 raft_consensus.cc:2454] T 000539a007854822a291b896a34d1fd4 P cfcfcb113794461896635465da4123c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 446a64fe32e34ad2a8aaab60e52bd491 in term 0.
I20260812 11:10:21.841910 23455 leader_election.cc:302] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446a64fe32e34ad2a8aaab60e52bd491, cfcfcb113794461896635465da4123c5; no voters:
I20260812 11:10:21.842170 23716 raft_consensus.cc:2781] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:21.842257 23716 raft_consensus.cc:482] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:21.842305 23716 raft_consensus.cc:3037] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:21.843393 23716 raft_consensus.cc:504] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021abc98a7854b27a223340267f68a7b" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37445 } } peers { permanent_uuid: "cfcfcb113794461896635465da4123c5" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45017 } } peers { permanent_uuid: "446a64fe32e34ad2a8aaab60e52bd491" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37223 } }
I20260812 11:10:21.843740 23716 leader_election.cc:288] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [CANDIDATE]: Term 1 election: Requested vote from peers 021abc98a7854b27a223340267f68a7b (127.18.174.194:37445), cfcfcb113794461896635465da4123c5 (127.18.174.193:45017)
I20260812 11:10:21.844175 23041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "000539a007854822a291b896a34d1fd4" candidate_uuid: "446a64fe32e34ad2a8aaab60e52bd491" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfcfcb113794461896635465da4123c5"
I20260812 11:10:21.844173 23301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "000539a007854822a291b896a34d1fd4" candidate_uuid: "446a64fe32e34ad2a8aaab60e52bd491" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "021abc98a7854b27a223340267f68a7b"
I20260812 11:10:21.844310 23301 raft_consensus.cc:3037] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:21.844310 23041 raft_consensus.cc:3037] T 000539a007854822a291b896a34d1fd4 P cfcfcb113794461896635465da4123c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:21.845613 23041 raft_consensus.cc:2454] T 000539a007854822a291b896a34d1fd4 P cfcfcb113794461896635465da4123c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446a64fe32e34ad2a8aaab60e52bd491 in term 1.
I20260812 11:10:21.845613 23301 raft_consensus.cc:2454] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 446a64fe32e34ad2a8aaab60e52bd491 in term 1.
I20260812 11:10:21.845929 23455 leader_election.cc:302] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 446a64fe32e34ad2a8aaab60e52bd491, cfcfcb113794461896635465da4123c5; no voters:
I20260812 11:10:21.846091 23716 raft_consensus.cc:2781] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:21.846316 23716 raft_consensus.cc:686] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [term 1 LEADER]: Becoming Leader. State: Replica: 446a64fe32e34ad2a8aaab60e52bd491, State: Running, Role: LEADER
I20260812 11:10:21.846661 23716 consensus_queue.cc:237] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021abc98a7854b27a223340267f68a7b" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37445 } } peers { permanent_uuid: "cfcfcb113794461896635465da4123c5" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45017 } } peers { permanent_uuid: "446a64fe32e34ad2a8aaab60e52bd491" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37223 } }
I20260812 11:10:21.850085 22752 catalog_manager.cc:5495] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 reported cstate change: term changed from 0 to 1, leader changed from <none> to 446a64fe32e34ad2a8aaab60e52bd491 (127.18.174.195). New cstate: current_term: 1 leader_uuid: "446a64fe32e34ad2a8aaab60e52bd491" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "021abc98a7854b27a223340267f68a7b" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfcfcb113794461896635465da4123c5" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "446a64fe32e34ad2a8aaab60e52bd491" member_type: VOTER last_known_addr { host: "127.18.174.195" port: 37223 } health_report { overall_health: HEALTHY } } }
I20260812 11:10:21.869459 23699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.865973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47164 (local address 127.18.174.195:37223)
0812 11:10:21.866113 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:21.866117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:21.866131 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:10:21.866215 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:21.866217 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:21.866271 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:21.866362 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:21.866599 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.867138 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.867980 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:21.868208 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:21.868299 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:21.868590 (+ 291us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:21.869026 (+ 436us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:21.869139 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:21.869259 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 11:10:21.869318 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:10:21.875777 23301 raft_consensus.cc:1261] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b [term 1 FOLLOWER]: Refusing update from remote peer 446a64fe32e34ad2a8aaab60e52bd491: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:21.875777 23041 raft_consensus.cc:1261] T 000539a007854822a291b896a34d1fd4 P cfcfcb113794461896635465da4123c5 [term 1 FOLLOWER]: Refusing update from remote peer 446a64fe32e34ad2a8aaab60e52bd491: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:21.876617 23723 consensus_queue.cc:1035] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfcfcb113794461896635465da4123c5" member_type: VOTER last_known_addr { host: "127.18.174.193" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:21.876850 23716 consensus_queue.cc:1035] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [LEADER]: Connected to new peer: Peer: permanent_uuid: "021abc98a7854b27a223340267f68a7b" member_type: VOTER last_known_addr { host: "127.18.174.194" port: 37445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:21.885676 23727 mvcc.cc:205] Tried to move back new op lower bound from 7317639257595072512 to 7317639257486573568. Current Snapshot: MvccSnapshot[applied={T|T < 7317639257595072512}]
I20260812 11:10:21.894927 22752 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:21.895141 22752 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:21.897702 22752 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6efed4eef6e43e2810df2b3868086ec: Sending DeleteTablet for 3 replicas of tablet 000539a007854822a291b896a34d1fd4
I20260812 11:10:21.898509 22996 tablet_service.cc:1514] Processing DeleteTablet for tablet 000539a007854822a291b896a34d1fd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:21 UTC) from {username='slave'} at 127.0.0.1:38468
I20260812 11:10:21.898540 23551 tablet_service.cc:1514] Processing DeleteTablet for tablet 000539a007854822a291b896a34d1fd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:21 UTC) from {username='slave'} at 127.0.0.1:47150
I20260812 11:10:21.899055 23261 tablet_service.cc:1514] Processing DeleteTablet for tablet 000539a007854822a291b896a34d1fd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:21 UTC) from {username='slave'} at 127.0.0.1:44968
I20260812 11:10:21.899204 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 22877
I20260812 11:10:21.909931 23761 tablet_replica.cc:330] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b: stopping tablet replica
I20260812 11:10:21.910920 23761 raft_consensus.cc:2229] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:21.911353 23761 raft_consensus.cc:2258] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:21.911789 23748 tablet_replica.cc:330] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491: stopping tablet replica
I20260812 11:10:21.912235 23748 raft_consensus.cc:2229] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:10:21.912672 23748 raft_consensus.cc:2258] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:21.917142 23761 ts_tablet_manager.cc:1905] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:21.918290 23748 ts_tablet_manager.cc:1905] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:21.919585 23761 ts_tablet_manager.cc:1918] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:21.919682 23761 log.cc:1196] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-1/wal/wals/000539a007854822a291b896a34d1fd4
I20260812 11:10:21.920006 23761 ts_tablet_manager.cc:1939] T 000539a007854822a291b896a34d1fd4 P 021abc98a7854b27a223340267f68a7b: Deleting consensus metadata
I20260812 11:10:21.920949 23748 ts_tablet_manager.cc:1918] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:21.921051 23748 log.cc:1196] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491: Deleting WAL directory at /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532756485707-19131-0/minicluster-data/ts-2/wal/wals/000539a007854822a291b896a34d1fd4
I20260812 11:10:21.921345 23748 ts_tablet_manager.cc:1939] T 000539a007854822a291b896a34d1fd4 P 446a64fe32e34ad2a8aaab60e52bd491: Deleting consensus metadata
I20260812 11:10:21.921486 22731 catalog_manager.cc:4841] TS 021abc98a7854b27a223340267f68a7b (127.18.174.194:37445): tablet 000539a007854822a291b896a34d1fd4 (table test-table [id=308f823f56fb4f3e9d7316549871ab6d]) successfully deleted
I20260812 11:10:21.922554 22725 catalog_manager.cc:4841] TS 446a64fe32e34ad2a8aaab60e52bd491 (127.18.174.195:37223): tablet 000539a007854822a291b896a34d1fd4 (table test-table [id=308f823f56fb4f3e9d7316549871ab6d]) successfully deleted
W20260812 11:10:21.926227 22731 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.174.193:45017 (error 108)
I20260812 11:10:21.926344 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 23133
I20260812 11:10:21.934504 23698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:21.934143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.193:45017 (local address 127.0.0.1:38478)
0812 11:10:21.934331 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:21.934404 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.193:45017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
W20260812 11:10:21.934702 22731 catalog_manager.cc:4584] TS cfcfcb113794461896635465da4123c5 (127.18.174.193:45017): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 000539a007854822a291b896a34d1fd4: Network error: Client connection negotiation failed: client connection to 127.18.174.193:45017: connect: Connection refused (error 111)
I20260812 11:10:21.946852 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 23414
I20260812 11:10:21.960597 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 22699
2026-08-12T11:10:21Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1185 ms)
[----------] 6 tests from EncryptionPolicyTest (11831 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:22 dist-test-slave-lgr5 krb5kdc[23769](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:22 dist-test-slave-lgr5 krb5kdc[23769](info): set up 2 sockets
Aug 12 11:10:22 dist-test-slave-lgr5 krb5kdc[23769](info): commencing operation
krb5kdc: starting...
W20260812 11:10:23.214304 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:23 dist-test-slave-lgr5 krb5kdc[23769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:10:23.345507 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39099
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39099
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:23.461117 23799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:23.461398 23799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:23.461460 23799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:23.465487 23799 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:23.465559 23799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:23.465585 23799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:23.465606 23799 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:23.465633 23799 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:23.470981 23799 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39099
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:23.472065 23799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:23.473098 23799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:23.481510 23806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:23.481532 23808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:23.481586 23799 server_base.cc:1034] running on GCE node
W20260812 11:10:23.481534 23810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:23.482498 23799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:23.483673 23799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:23.484854 23799 hybrid_clock.cc:648] HybridClock initialized: now 1786533023484823 us; error 45 us; skew 500 ppm
Aug 12 11:10:23 dist-test-slave-lgr5 krb5kdc[23769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533023, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:23.487735 23799 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:10:23.488786 23799 webserver.cc:460] Webserver started at http://127.0.0.1:44261/ using document root <none> and password file <none>
I20260812 11:10:23.489341 23799 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:23.489423 23799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:23.489635 23799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:23.491794 23799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "4e0c5afdcd5c4a69b898ab9b1ce6c042"
format_stamp: "Formatted at 2026-08-12 11:10:23 on dist-test-slave-lgr5"
server_key: "cffc701806f088abfa81971845e40151"
server_key_iv: "8faccce84002a6c09fc3a8c1e84c2882"
server_key_version: "encryptionkey@0"
I20260812 11:10:23.492383 23799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "4e0c5afdcd5c4a69b898ab9b1ce6c042"
format_stamp: "Formatted at 2026-08-12 11:10:23 on dist-test-slave-lgr5"
server_key: "cffc701806f088abfa81971845e40151"
server_key_iv: "8faccce84002a6c09fc3a8c1e84c2882"
server_key_version: "encryptionkey@0"
I20260812 11:10:23.496258 23799 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:10:23.498787 23826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:23.500033 23799 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:23.500203 23799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "4e0c5afdcd5c4a69b898ab9b1ce6c042"
format_stamp: "Formatted at 2026-08-12 11:10:23 on dist-test-slave-lgr5"
server_key: "cffc701806f088abfa81971845e40151"
server_key_iv: "8faccce84002a6c09fc3a8c1e84c2882"
server_key_version: "encryptionkey@0"
I20260812 11:10:23.500314 23799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:23.531230 23799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:23.534480 23799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:23.534668 23799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:23.541724 23799 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39099
I20260812 11:10:23.541738 23918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39099 every 8 connection(s)
I20260812 11:10:23.542725 23799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:23.545610 23920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:23.551043 23920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042: Bootstrap starting.
I20260812 11:10:23.553028 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 23799
I20260812 11:10:23.553169 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:23.553442 19131 external_mini_cluster.cc:1428] Setting key e5d65a322cdaa281d0abbd326fce2b7b
I20260812 11:10:23.553557 23920 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:23.554389 23920 log.cc:824] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:23.556500 23920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042: No bootstrap required, opened a new log
I20260812 11:10:23.559940 23920 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0c5afdcd5c4a69b898ab9b1ce6c042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39099 } }
I20260812 11:10:23.560249 23920 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:23.560319 23920 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0c5afdcd5c4a69b898ab9b1ce6c042, State: Initialized, Role: FOLLOWER
I20260812 11:10:23.560782 23920 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0c5afdcd5c4a69b898ab9b1ce6c042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39099 } }
I20260812 11:10:23.560925 23920 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:23.560997 23920 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:23.561088 23920 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [term 0 FOLLOWER]: Advancing to term 1
Aug 12 11:10:23 dist-test-slave-lgr5 krb5kdc[23769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:10:23.562240 23920 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0c5afdcd5c4a69b898ab9b1ce6c042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39099 } }
I20260812 11:10:23.562577 23920 leader_election.cc:302] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e0c5afdcd5c4a69b898ab9b1ce6c042; no voters:
I20260812 11:10:23.562899 23920 leader_election.cc:288] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:23.563037 23928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:23.563328 23928 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [term 1 LEADER]: Becoming Leader. State: Replica: 4e0c5afdcd5c4a69b898ab9b1ce6c042, State: Running, Role: LEADER
I20260812 11:10:23.563684 23928 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0c5afdcd5c4a69b898ab9b1ce6c042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39099 } }
I20260812 11:10:23.564368 23920 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:23.565601 23929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e0c5afdcd5c4a69b898ab9b1ce6c042" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0c5afdcd5c4a69b898ab9b1ce6c042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39099 } } }
I20260812 11:10:23.565729 23929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:23.565675 23930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e0c5afdcd5c4a69b898ab9b1ce6c042. Latest consensus state: current_term: 1 leader_uuid: "4e0c5afdcd5c4a69b898ab9b1ce6c042" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0c5afdcd5c4a69b898ab9b1ce6c042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39099 } } }
I20260812 11:10:23.565791 23930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:23.568610 23927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:23.554541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49823 (local address 127.0.0.1:39099)
0812 11:10:23.554959 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:23.554974 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:23.555025 (+ 51us) server_negotiation.cc:407] Connection header received
0812 11:10:23.555687 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:23.555704 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:23.556035 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:23.556403 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:23.557209 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:23.558201 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:23.559088 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:23.559574 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:23.559725 (+ 151us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:23.562746 (+ 3021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:23.562753 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:23.562773 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:23.562805 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:23.564941 (+ 2136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:23.565549 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:23.565556 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:23.565563 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:23.565726 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:23.566172 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:23.566176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:23.566177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:23.566731 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:23.566970 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:23.567345 (+ 375us) server_negotiation.cc:299] Negotiation successful
0812 11:10:23.567585 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"spinlock_wait_cycles":24832,"thread_start_us":114,"threads_started":1}
W20260812 11:10:23.569272 23963 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:10:23.569336 23963 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:10:23.569393 23954 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:23.570199 23954 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:23.572134 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:23.576073 23954 catalog_manager.cc:1347] Generated new cluster ID: 5eb707f450d74ef2a3121f386822769d
I20260812 11:10:23.576154 23954 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:23.582984 23927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:23.574426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37345 (local address 127.0.0.1:39099)
0812 11:10:23.574533 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:23.574537 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:23.574659 (+ 122us) server_negotiation.cc:407] Connection header received
0812 11:10:23.574792 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:23.574795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:23.574843 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:23.574923 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:23.575718 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:23.576551 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:23.577670 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:23.578038 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:23.578138 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:23.579657 (+ 1519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:23.579661 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:23.579664 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:23.579691 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:23.581256 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:23.581760 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:23.581763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:23.581765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:23.581853 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:23.582132 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:23.582135 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:23.582137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:23.582349 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:23.582504 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:23.582724 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 11:10:23.582824 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:10:23.589991 23954 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:23.590986 23954 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:23.595706 23954 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e0c5afdcd5c4a69b898ab9b1ce6c042: Generated new TSK 0
I20260812 11:10:23.596436 23954 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:23.601614 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 23799
W20260812 11:10:23.621333 23763 connection.cc:535] client connection to 127.0.0.1:39099 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39099): Connection reset by peer (error 104)
2026-08-12T11:10:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1644 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:23 dist-test-slave-lgr5 krb5kdc[23989](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:23 dist-test-slave-lgr5 krb5kdc[23989](info): set up 2 sockets
Aug 12 11:10:23 dist-test-slave-lgr5 krb5kdc[23989](info): commencing operation
krb5kdc: starting...
W20260812 11:10:24.806299 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:24 dist-test-slave-lgr5 krb5kdc[23989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:10:24.931411 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36581
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:25.047358 24008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:25.047637 24008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:25.047696 24008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:25.051688 24008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:25.051757 24008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:25.051784 24008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:25.051805 24008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:25.051824 24008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:25.057164 24008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36581
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:25.058256 24008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:25.059295 24008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:25.067934 24018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:25.068018 24020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:25.068013 24023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:25.068009 24008 server_base.cc:1034] running on GCE node
I20260812 11:10:25.068763 24008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:25.069878 24008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:25.071034 24008 hybrid_clock.cc:648] HybridClock initialized: now 1786533025071016 us; error 29 us; skew 500 ppm
Aug 12 11:10:25 dist-test-slave-lgr5 krb5kdc[23989](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533025, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:25.080354 24008 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:10:25.081336 24008 webserver.cc:460] Webserver started at http://127.0.0.1:40507/ using document root <none> and password file <none>
I20260812 11:10:25.081887 24008 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:25.081969 24008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:25.082182 24008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:25.084336 24008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "0fbbcbf627e8448297959c4f99460e7d"
format_stamp: "Formatted at 2026-08-12 11:10:25 on dist-test-slave-lgr5"
server_key: "8b41dbc162d8e13ce9e284589ec6d3a8"
server_key_iv: "96856b273f1773b44c9bd84099b29a3d"
server_key_version: "encryptionkey@0"
I20260812 11:10:25.084880 24008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "0fbbcbf627e8448297959c4f99460e7d"
format_stamp: "Formatted at 2026-08-12 11:10:25 on dist-test-slave-lgr5"
server_key: "8b41dbc162d8e13ce9e284589ec6d3a8"
server_key_iv: "96856b273f1773b44c9bd84099b29a3d"
server_key_version: "encryptionkey@0"
I20260812 11:10:25.088656 24008 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:10:25.091141 24034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:25.092558 24008 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:25.092684 24008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "0fbbcbf627e8448297959c4f99460e7d"
format_stamp: "Formatted at 2026-08-12 11:10:25 on dist-test-slave-lgr5"
server_key: "8b41dbc162d8e13ce9e284589ec6d3a8"
server_key_iv: "96856b273f1773b44c9bd84099b29a3d"
server_key_version: "encryptionkey@0"
I20260812 11:10:25.092790 24008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:25.112578 24008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:25.115666 24008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:25.115852 24008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:25.123137 24008 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36581
I20260812 11:10:25.123162 24123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36581 every 8 connection(s)
I20260812 11:10:25.124145 24008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:25.127061 24125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:25.128995 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 24008
I20260812 11:10:25.129140 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:25.129451 19131 external_mini_cluster.cc:1428] Setting key a16bf1eb48f2cb16c3c8ae72b4ecf982
I20260812 11:10:25.133605 24125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d: Bootstrap starting.
I20260812 11:10:25.136035 24125 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:25.137028 24125 log.cc:824] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:25.138665 24134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:25.130918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50137 (local address 127.0.0.1:36581)
0812 11:10:25.131356 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:25.131375 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:25.131412 (+ 37us) server_negotiation.cc:407] Connection header received
0812 11:10:25.132056 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:25.132073 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:25.132441 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:25.132743 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:25.133148 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:25.134135 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:25.135051 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:25.135753 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:25.135928 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:25.136928 (+ 1000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:25.136933 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:25.136947 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:25.137350 (+ 403us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:25.137418 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:25.137451 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:25.137589 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:25.137771 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 11:10:25.137895 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":124,"threads_started":1}
I20260812 11:10:25.139238 24125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d: No bootstrap required, opened a new log
I20260812 11:10:25.141780 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:25.143640 24125 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbbcbf627e8448297959c4f99460e7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36581 } }
I20260812 11:10:25.143929 24125 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:25.144044 24125 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fbbcbf627e8448297959c4f99460e7d, State: Initialized, Role: FOLLOWER
I20260812 11:10:25.144570 24125 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbbcbf627e8448297959c4f99460e7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36581 } }
I20260812 11:10:25.144750 24125 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:25.144833 24125 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:25.144941 24125 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:25.146018 24125 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbbcbf627e8448297959c4f99460e7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36581 } }
I20260812 11:10:25.146376 24125 leader_election.cc:302] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fbbcbf627e8448297959c4f99460e7d; no voters:
I20260812 11:10:25.146728 24125 leader_election.cc:288] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:25.146862 24144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:25.147083 24144 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [term 1 LEADER]: Becoming Leader. State: Replica: 0fbbcbf627e8448297959c4f99460e7d, State: Running, Role: LEADER
I20260812 11:10:25.147491 24144 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbbcbf627e8448297959c4f99460e7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36581 } }
I20260812 11:10:25.148171 24125 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:25.148572 24134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:25.144118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52957 (local address 127.0.0.1:36581)
0812 11:10:25.144229 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:25.144234 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:25.144384 (+ 150us) server_negotiation.cc:407] Connection header received
0812 11:10:25.144498 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:25.144501 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:25.144546 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:25.144631 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:25.144855 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:25.145575 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:25.146369 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:25.146746 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:25.146850 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:25.147963 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:25.147967 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:25.147970 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:25.147993 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:25.148026 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:25.148041 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:25.148171 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:25.148389 (+ 218us) server_negotiation.cc:299] Negotiation successful
0812 11:10:25.148437 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:10:25.149585 24145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fbbcbf627e8448297959c4f99460e7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbbcbf627e8448297959c4f99460e7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36581 } } }
I20260812 11:10:25.149724 24145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:25.150075 24147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fbbcbf627e8448297959c4f99460e7d. Latest consensus state: current_term: 1 leader_uuid: "0fbbcbf627e8448297959c4f99460e7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbbcbf627e8448297959c4f99460e7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36581 } } }
I20260812 11:10:25.150158 24147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:25.150157 24160 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:25.153542 24160 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:25.159639 24160 catalog_manager.cc:1347] Generated new cluster ID: 21584dc20d924307b6c521ae13068a22
I20260812 11:10:25.159718 24160 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:25.175164 24160 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:25.176532 24160 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:25.188611 24160 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fbbcbf627e8448297959c4f99460e7d: Generated new TSK 0
I20260812 11:10:25.189563 24160 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:25.200917 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 24008
W20260812 11:10:25.217247 23986 connection.cc:535] client connection to 127.0.0.1:36581 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36581): Connection reset by peer (error 104)
2026-08-12T11:10:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1595 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:25 dist-test-slave-lgr5 krb5kdc[24173](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:25 dist-test-slave-lgr5 krb5kdc[24173](info): set up 2 sockets
Aug 12 11:10:25 dist-test-slave-lgr5 krb5kdc[24173](info): commencing operation
krb5kdc: starting...
W20260812 11:10:26.396469 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:26 dist-test-slave-lgr5 krb5kdc[24173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:10:26.523082 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46175
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46175
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:26.635397 24201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:26.635687 24201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:26.635730 24201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:26.639756 24201 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:26.639817 24201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:26.639835 24201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:26.639850 24201 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:26.639864 24201 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:26.645197 24201 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46175
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:26.646227 24201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:26.647218 24201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:26.655656 24210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:26.655674 24211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:26.655804 24201 server_base.cc:1034] running on GCE node
W20260812 11:10:26.655674 24214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:26.656692 24201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:26.657817 24201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:26.658999 24201 hybrid_clock.cc:648] HybridClock initialized: now 1786533026658972 us; error 29 us; skew 500 ppm
Aug 12 11:10:26 dist-test-slave-lgr5 krb5kdc[24173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533026, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:26.661751 24201 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:10:26.662649 24201 webserver.cc:460] Webserver started at http://127.0.0.1:42701/ using document root <none> and password file <none>
I20260812 11:10:26.663165 24201 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:26.663223 24201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:26.663404 24201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:26.665478 24201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "eec52a9636e1451fad6f12407a8b48ad"
format_stamp: "Formatted at 2026-08-12 11:10:26 on dist-test-slave-lgr5"
server_key: "817cd36fefa4b96afd417c1185870f89"
server_key_iv: "1faf4c5e554427a6e996ed2f34abe46f"
server_key_version: "encryptionkey@0"
I20260812 11:10:26.665987 24201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "eec52a9636e1451fad6f12407a8b48ad"
format_stamp: "Formatted at 2026-08-12 11:10:26 on dist-test-slave-lgr5"
server_key: "817cd36fefa4b96afd417c1185870f89"
server_key_iv: "1faf4c5e554427a6e996ed2f34abe46f"
server_key_version: "encryptionkey@0"
I20260812 11:10:26.669590 24201 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:10:26.671844 24224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:26.673101 24201 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:26.673215 24201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "eec52a9636e1451fad6f12407a8b48ad"
format_stamp: "Formatted at 2026-08-12 11:10:26 on dist-test-slave-lgr5"
server_key: "817cd36fefa4b96afd417c1185870f89"
server_key_iv: "1faf4c5e554427a6e996ed2f34abe46f"
server_key_version: "encryptionkey@0"
I20260812 11:10:26.673341 24201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:26.677832 24201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:26.680913 24201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:26.681082 24201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:26.687714 24201 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46175
I20260812 11:10:26.687732 24319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46175 every 8 connection(s)
I20260812 11:10:26.688680 24201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:26.689762 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 24201
I20260812 11:10:26.689903 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:26.690231 19131 external_mini_cluster.cc:1428] Setting key ab56f945c58e9340d76b563bafad25a3
I20260812 11:10:26.692030 24320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:26.696130 24324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:26.691635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43403 (local address 127.0.0.1:46175)
0812 11:10:26.692104 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:26.692127 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:26.692171 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:10:26.693023 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:26.693046 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:26.693400 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:26.693836 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:26.694607 (+ 771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:26.694613 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:26.694629 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:26.694641 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:26.694714 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:26.694744 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:26.694887 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:26.694965 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 11:10:26.695140 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":134,"threads_started":1}
I20260812 11:10:26.698959 24320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad: Bootstrap starting.
I20260812 11:10:26.699131 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:26.701721 24320 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:26.702521 24320 log.cc:824] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:26.703135 24324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:26.701517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42077 (local address 127.0.0.1:46175)
0812 11:10:26.701644 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:26.701648 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:26.701907 (+ 259us) server_negotiation.cc:407] Connection header received
0812 11:10:26.701969 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:26.701972 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:26.702010 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:26.702093 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:26.702736 (+ 643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:26.702740 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:26.702743 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:26.702755 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:26.702784 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:26.702812 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:26.702886 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:26.702983 (+ 97us) server_negotiation.cc:299] Negotiation successful
0812 11:10:26.703020 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:10:26.704434 24320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad: No bootstrap required, opened a new log
I20260812 11:10:26.707777 24320 raft_consensus.cc:348] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec52a9636e1451fad6f12407a8b48ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46175 } }
I20260812 11:10:26.707994 24320 raft_consensus.cc:374] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:26.708029 24320 raft_consensus.cc:729] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec52a9636e1451fad6f12407a8b48ad, State: Initialized, Role: FOLLOWER
I20260812 11:10:26.708433 24320 consensus_queue.cc:260] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec52a9636e1451fad6f12407a8b48ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46175 } }
I20260812 11:10:26.708562 24320 raft_consensus.cc:388] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:26.708607 24320 raft_consensus.cc:482] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:26.708678 24320 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:26.709499 24320 raft_consensus.cc:504] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec52a9636e1451fad6f12407a8b48ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46175 } }
I20260812 11:10:26.709797 24320 leader_election.cc:302] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eec52a9636e1451fad6f12407a8b48ad; no voters:
I20260812 11:10:26.710072 24320 leader_election.cc:288] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:26.710152 24339 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:26.710326 24339 raft_consensus.cc:686] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [term 1 LEADER]: Becoming Leader. State: Replica: eec52a9636e1451fad6f12407a8b48ad, State: Running, Role: LEADER
I20260812 11:10:26.710669 24339 consensus_queue.cc:237] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec52a9636e1451fad6f12407a8b48ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46175 } }
I20260812 11:10:26.711367 24320 sys_catalog.cc:564] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:26.712448 24342 sys_catalog.cc:455] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eec52a9636e1451fad6f12407a8b48ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec52a9636e1451fad6f12407a8b48ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46175 } } }
I20260812 11:10:26.712585 24342 sys_catalog.cc:458] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:26.712740 24341 sys_catalog.cc:455] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader eec52a9636e1451fad6f12407a8b48ad. Latest consensus state: current_term: 1 leader_uuid: "eec52a9636e1451fad6f12407a8b48ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec52a9636e1451fad6f12407a8b48ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46175 } } }
I20260812 11:10:26.712842 24341 sys_catalog.cc:458] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:26.713784 24351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:26.716492 24351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:26.721562 24351 catalog_manager.cc:1347] Generated new cluster ID: 288f30a9024143ef9a51687c3b7735ad
I20260812 11:10:26.721623 24351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:26.735162 24351 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:26.735523 24351 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:26.740759 24351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eec52a9636e1451fad6f12407a8b48ad: Generated new TSK 0
I20260812 11:10:26.741556 24351 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:26.754971 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 24201
2026-08-12T11:10:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1543 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:26 dist-test-slave-lgr5 krb5kdc[24370](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:26 dist-test-slave-lgr5 krb5kdc[24370](info): set up 2 sockets
Aug 12 11:10:26 dist-test-slave-lgr5 krb5kdc[24370](info): commencing operation
krb5kdc: starting...
W20260812 11:10:27.952456 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:28 dist-test-slave-lgr5 krb5kdc[24370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:10:28.083215 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41753
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:28.195240 24394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:28.195586 24394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:28.195658 24394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:28.199987 24394 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:28.200104 24394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:28.200141 24394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:28.200179 24394 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:28.200214 24394 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:28.205936 24394 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:28.207134 24394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:28.208240 24394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:28.217463 24402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:28.217522 24406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:28.217641 24394 server_base.cc:1034] running on GCE node
W20260812 11:10:28.217463 24403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:28.218405 24394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:28.219627 24394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:28.220784 24394 hybrid_clock.cc:648] HybridClock initialized: now 1786533028220767 us; error 30 us; skew 500 ppm
Aug 12 11:10:28 dist-test-slave-lgr5 krb5kdc[24370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533028, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:28.223479 24394 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:10:28.224413 24394 webserver.cc:460] Webserver started at http://127.0.0.1:42415/ using document root <none> and password file <none>
I20260812 11:10:28.224949 24394 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:28.225010 24394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:28.225183 24394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:28.227221 24394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "16f5db1d76514cfd92d57cd9d1dd2dda"
format_stamp: "Formatted at 2026-08-12 11:10:28 on dist-test-slave-lgr5"
server_key: "a5da07ad24d6baaf1854f41b2fc6f713"
server_key_iv: "e608cc5e56dbcbc7c8df1179927f2d17"
server_key_version: "encryptionkey@0"
I20260812 11:10:28.227739 24394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "16f5db1d76514cfd92d57cd9d1dd2dda"
format_stamp: "Formatted at 2026-08-12 11:10:28 on dist-test-slave-lgr5"
server_key: "a5da07ad24d6baaf1854f41b2fc6f713"
server_key_iv: "e608cc5e56dbcbc7c8df1179927f2d17"
server_key_version: "encryptionkey@0"
I20260812 11:10:28.231534 24394 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:10:28.233989 24417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:28.235255 24394 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:28.235368 24394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "16f5db1d76514cfd92d57cd9d1dd2dda"
format_stamp: "Formatted at 2026-08-12 11:10:28 on dist-test-slave-lgr5"
server_key: "a5da07ad24d6baaf1854f41b2fc6f713"
server_key_iv: "e608cc5e56dbcbc7c8df1179927f2d17"
server_key_version: "encryptionkey@0"
I20260812 11:10:28.235461 24394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:28.258440 24394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:28.261656 24394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:28.261811 24394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:28.268586 24394 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41753
I20260812 11:10:28.268638 24521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41753 every 8 connection(s)
I20260812 11:10:28.269572 24394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:28.272413 24524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:28.278237 24524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda: Bootstrap starting.
I20260812 11:10:28.279647 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 24394
I20260812 11:10:28.279757 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:28.280002 19131 external_mini_cluster.cc:1428] Setting key 8ff02d870efc9085327ede3105ecdd39
I20260812 11:10:28.281075 24524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:28.281862 24524 log.cc:824] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:28.284147 24524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda: No bootstrap required, opened a new log
I20260812 11:10:28.288578 24524 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16f5db1d76514cfd92d57cd9d1dd2dda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41753 } }
I20260812 11:10:28.288872 24524 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:28.288950 24524 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f5db1d76514cfd92d57cd9d1dd2dda, State: Initialized, Role: FOLLOWER
Aug 12 11:10:28 dist-test-slave-lgr5 krb5kdc[24370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:10:28.289441 24524 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16f5db1d76514cfd92d57cd9d1dd2dda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41753 } }
I20260812 11:10:28.289593 24524 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:28.289669 24524 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:28.289788 24524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:28.290989 24524 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16f5db1d76514cfd92d57cd9d1dd2dda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41753 } }
I20260812 11:10:28.291389 24524 leader_election.cc:302] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16f5db1d76514cfd92d57cd9d1dd2dda; no voters:
I20260812 11:10:28.291787 24524 leader_election.cc:288] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:28.291859 24533 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:28.292106 24533 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [term 1 LEADER]: Becoming Leader. State: Replica: 16f5db1d76514cfd92d57cd9d1dd2dda, State: Running, Role: LEADER
I20260812 11:10:28.292451 24533 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16f5db1d76514cfd92d57cd9d1dd2dda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41753 } }
I20260812 11:10:28.293259 24524 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:28.294369 24540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16f5db1d76514cfd92d57cd9d1dd2dda. Latest consensus state: current_term: 1 leader_uuid: "16f5db1d76514cfd92d57cd9d1dd2dda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16f5db1d76514cfd92d57cd9d1dd2dda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41753 } } }
I20260812 11:10:28.294369 24534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16f5db1d76514cfd92d57cd9d1dd2dda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16f5db1d76514cfd92d57cd9d1dd2dda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41753 } } }
I20260812 11:10:28.294520 24534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:28.294520 24540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:28.294938 24557 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:28.296211 24531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:28.281145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33077 (local address 127.0.0.1:41753)
0812 11:10:28.281591 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:28.281608 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:28.281645 (+ 37us) server_negotiation.cc:407] Connection header received
0812 11:10:28.282343 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:28.282363 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:28.282711 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:28.283006 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:28.283903 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:28.285002 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:28.286207 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:28.286719 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:28.286842 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:28.289758 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:28.289765 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:28.289791 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:28.289829 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:28.291890 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:28.292525 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:28.292531 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:28.292537 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:28.292685 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:28.292981 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:28.292984 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:28.292986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:28.293581 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:28.293785 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:28.294741 (+ 956us) server_negotiation.cc:299] Negotiation successful
0812 11:10:28.295113 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":132,"threads_started":1}
I20260812 11:10:28.298316 24557 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:28.299463 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:28.304710 24557 catalog_manager.cc:1347] Generated new cluster ID: 18f966c5fe154a55a9e51cc2803e67d0
I20260812 11:10:28.304775 24557 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:28.309321 24531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:28.301783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53995 (local address 127.0.0.1:41753)
0812 11:10:28.301905 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:28.301909 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:28.302050 (+ 141us) server_negotiation.cc:407] Connection header received
0812 11:10:28.302175 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:28.302178 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:28.302225 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:28.302316 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:28.303139 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:28.303702 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:28.304604 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:28.304855 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:28.304949 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:28.306228 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:28.306232 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:28.306235 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:28.306262 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:28.307595 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:28.308020 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:28.308024 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:28.308025 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:28.308158 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:28.308498 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:28.308501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:28.308503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:28.308679 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:28.308798 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:28.309046 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 11:10:28.309159 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:10:28.338227 24557 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:28.339566 24557 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:28.350705 24557 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16f5db1d76514cfd92d57cd9d1dd2dda: Generated new TSK 0
I20260812 11:10:28.351630 24557 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:28.365278 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 24394
2026-08-12T11:10:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1624 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:28 dist-test-slave-lgr5 krb5kdc[24584](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:28 dist-test-slave-lgr5 krb5kdc[24584](info): set up 2 sockets
Aug 12 11:10:28 dist-test-slave-lgr5 krb5kdc[24584](info): commencing operation
krb5kdc: starting...
W20260812 11:10:29.557756 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:29 dist-test-slave-lgr5 krb5kdc[24584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:10:29.683148 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42169
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42169
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:29.795881 24603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:29.796227 24603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:29.796276 24603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:29.800295 24603 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:29.800357 24603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:29.800376 24603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:29.800392 24603 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:29.800410 24603 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:29.805815 24603 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42169
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:29.806912 24603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:29.807943 24603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:29.816301 24620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:29.816336 24618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:29.816437 24603 server_base.cc:1034] running on GCE node
W20260812 11:10:29.816339 24615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:29.817145 24603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:29.818245 24603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:29.819422 24603 hybrid_clock.cc:648] HybridClock initialized: now 1786533029819404 us; error 26 us; skew 500 ppm
Aug 12 11:10:29 dist-test-slave-lgr5 krb5kdc[24584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533029, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:29.822178 24603 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:10:29.823110 24603 webserver.cc:460] Webserver started at http://127.0.0.1:41063/ using document root <none> and password file <none>
I20260812 11:10:29.823655 24603 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:29.823716 24603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:29.823921 24603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:29.826010 24603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "59f807f23f7d4ed19414403031e162e0"
format_stamp: "Formatted at 2026-08-12 11:10:29 on dist-test-slave-lgr5"
server_key: "ebb63b8734aea9b42c9686a19ff9851b"
server_key_iv: "6fe6bb717f53a986642d73dc93f5cb5f"
server_key_version: "encryptionkey@0"
I20260812 11:10:29.826561 24603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "59f807f23f7d4ed19414403031e162e0"
format_stamp: "Formatted at 2026-08-12 11:10:29 on dist-test-slave-lgr5"
server_key: "ebb63b8734aea9b42c9686a19ff9851b"
server_key_iv: "6fe6bb717f53a986642d73dc93f5cb5f"
server_key_version: "encryptionkey@0"
I20260812 11:10:29.830236 24603 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:10:29.832656 24631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:29.833926 24603 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:29.834053 24603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "59f807f23f7d4ed19414403031e162e0"
format_stamp: "Formatted at 2026-08-12 11:10:29 on dist-test-slave-lgr5"
server_key: "ebb63b8734aea9b42c9686a19ff9851b"
server_key_iv: "6fe6bb717f53a986642d73dc93f5cb5f"
server_key_version: "encryptionkey@0"
I20260812 11:10:29.834153 24603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:29.854041 24603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:29.857254 24603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:29.857452 24603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:29.864615 24603 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42169
I20260812 11:10:29.864631 24723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42169 every 8 connection(s)
I20260812 11:10:29.865581 24603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:29.868462 24729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:29.869746 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 24603
I20260812 11:10:29.869896 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:29.870187 19131 external_mini_cluster.cc:1428] Setting key c19c11ad1e84839e06bcac8bb5d3af31
I20260812 11:10:29.874605 24729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0: Bootstrap starting.
I20260812 11:10:29.876886 24729 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:29.877626 24729 log.cc:824] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:29.878970 24734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:29.871634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50733 (local address 127.0.0.1:42169)
0812 11:10:29.872072 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:29.872106 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:29.872153 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:10:29.872808 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:29.872826 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:29.873163 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:29.873469 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:29.873903 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:29.874899 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:29.875784 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:29.876292 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:29.876443 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:29.877290 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:29.877295 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:29.877309 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:29.877686 (+ 377us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:29.877757 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:29.877794 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:29.877882 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:29.878015 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 11:10:29.878237 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":119,"threads_started":1}
I20260812 11:10:29.879542 24729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0: No bootstrap required, opened a new log
I20260812 11:10:29.881943 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:29.883867 24729 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59f807f23f7d4ed19414403031e162e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42169 } }
I20260812 11:10:29.884155 24729 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:29.884214 24729 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59f807f23f7d4ed19414403031e162e0, State: Initialized, Role: FOLLOWER
I20260812 11:10:29.884697 24729 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59f807f23f7d4ed19414403031e162e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42169 } }
I20260812 11:10:29.884868 24729 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:29.884945 24729 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:29.885058 24729 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:29.886175 24729 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59f807f23f7d4ed19414403031e162e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42169 } }
I20260812 11:10:29.886519 24729 leader_election.cc:302] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59f807f23f7d4ed19414403031e162e0; no voters:
I20260812 11:10:29.886804 24729 leader_election.cc:288] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:29.886973 24747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:29.887214 24747 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [term 1 LEADER]: Becoming Leader. State: Replica: 59f807f23f7d4ed19414403031e162e0, State: Running, Role: LEADER
I20260812 11:10:29.887539 24747 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59f807f23f7d4ed19414403031e162e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42169 } }
I20260812 11:10:29.888226 24729 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:29.889045 24734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:29.884231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57595 (local address 127.0.0.1:42169)
0812 11:10:29.884344 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:29.884349 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:29.884608 (+ 259us) server_negotiation.cc:407] Connection header received
0812 11:10:29.884692 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:29.884695 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:29.884743 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:29.884830 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:29.885179 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:29.885916 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:29.886931 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:29.887250 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:29.887348 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:29.888378 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:29.888382 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:29.888384 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:29.888397 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:29.888427 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:29.888439 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:29.888535 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:29.888860 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 11:10:29.888911 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 11:10:29.889253 24751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59f807f23f7d4ed19414403031e162e0. Latest consensus state: current_term: 1 leader_uuid: "59f807f23f7d4ed19414403031e162e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59f807f23f7d4ed19414403031e162e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42169 } } }
I20260812 11:10:29.889408 24751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:29.889732 24749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59f807f23f7d4ed19414403031e162e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59f807f23f7d4ed19414403031e162e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42169 } } }
I20260812 11:10:29.889832 24749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0 [sys.catalog]: This master's current role is: LEADER
W20260812 11:10:29.893337 24774 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:10:29.893429 24774 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:10:29.893512 24762 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:29.894224 24762 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:29.899657 24762 catalog_manager.cc:1347] Generated new cluster ID: b01cca3d1bca46bb94e5cd2967faed14
I20260812 11:10:29.899741 24762 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:29.919333 24762 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:29.920367 24762 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:29.927345 24762 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59f807f23f7d4ed19414403031e162e0: Generated new TSK 0
I20260812 11:10:29.928042 24762 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:29.936033 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 24603
2026-08-12T11:10:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1569 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:30 dist-test-slave-lgr5 krb5kdc[24783](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:30 dist-test-slave-lgr5 krb5kdc[24783](info): set up 2 sockets
Aug 12 11:10:30 dist-test-slave-lgr5 krb5kdc[24783](info): commencing operation
krb5kdc: starting...
W20260812 11:10:31.150020 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:31 dist-test-slave-lgr5 krb5kdc[24783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:10:31.279956 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41589
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41589
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:31.398262 24809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:31.398559 24809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:31.398623 24809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:31.402701 24809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:31.402773 24809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:31.402801 24809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:31.402822 24809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:31.402842 24809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:31.408355 24809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:31.409492 24809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:31.410545 24809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:31.419246 24818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:31.419246 24819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:31.419373 24809 server_base.cc:1034] running on GCE node
W20260812 11:10:31.419323 24823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:31.420143 24809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:31.421277 24809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:31.422452 24809 hybrid_clock.cc:648] HybridClock initialized: now 1786533031422433 us; error 34 us; skew 500 ppm
Aug 12 11:10:31 dist-test-slave-lgr5 krb5kdc[24783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533031, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:31.431748 24809 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:10:31.432775 24809 webserver.cc:460] Webserver started at http://127.0.0.1:37265/ using document root <none> and password file <none>
I20260812 11:10:31.433372 24809 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:31.433446 24809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:31.433650 24809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:31.435834 24809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "8504ac0a0cc046b99c642d1182e71377"
format_stamp: "Formatted at 2026-08-12 11:10:31 on dist-test-slave-lgr5"
server_key: "b9f3050af3829e5639970c87aaaba29d"
server_key_iv: "2e44ad370e46864e0b697541a97ab7e5"
server_key_version: "encryptionkey@0"
I20260812 11:10:31.436419 24809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "8504ac0a0cc046b99c642d1182e71377"
format_stamp: "Formatted at 2026-08-12 11:10:31 on dist-test-slave-lgr5"
server_key: "b9f3050af3829e5639970c87aaaba29d"
server_key_iv: "2e44ad370e46864e0b697541a97ab7e5"
server_key_version: "encryptionkey@0"
I20260812 11:10:31.440426 24809 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:10:31.442950 24836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:31.444314 24809 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:31.444438 24809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "8504ac0a0cc046b99c642d1182e71377"
format_stamp: "Formatted at 2026-08-12 11:10:31 on dist-test-slave-lgr5"
server_key: "b9f3050af3829e5639970c87aaaba29d"
server_key_iv: "2e44ad370e46864e0b697541a97ab7e5"
server_key_version: "encryptionkey@0"
I20260812 11:10:31.444537 24809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:31.449440 24809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:31.452723 24809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:31.452898 24809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:31.460641 24809 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41589
I20260812 11:10:31.460667 24921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41589 every 8 connection(s)
I20260812 11:10:31.461583 24809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:31.464478 24922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:31.467373 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 24809
I20260812 11:10:31.467504 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:31.467738 19131 external_mini_cluster.cc:1428] Setting key 93d92f20d9a8b47c13bd26ad808188b7
I20260812 11:10:31.470606 24922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377: Bootstrap starting.
I20260812 11:10:31.472965 24925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:31.469139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41167 (local address 127.0.0.1:41589)
0812 11:10:31.469573 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:31.469588 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:31.469624 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:10:31.470283 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:31.470302 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:31.470602 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:31.470910 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:31.471707 (+ 797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:31.471711 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:31.471723 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:31.471733 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:31.471791 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:31.471811 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:31.471921 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:31.472025 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 11:10:31.472206 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":125,"threads_started":1}
I20260812 11:10:31.473261 24922 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:31.474038 24922 log.cc:824] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:31.475905 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:31.476280 24922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377: No bootstrap required, opened a new log
I20260812 11:10:31.479557 24925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:31.478019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33779 (local address 127.0.0.1:41589)
0812 11:10:31.478153 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:31.478158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:31.478286 (+ 128us) server_negotiation.cc:407] Connection header received
0812 11:10:31.478386 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:31.478389 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:31.478424 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:31.478507 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:31.479140 (+ 633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:31.479144 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:31.479147 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:31.479160 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:31.479192 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:31.479206 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:31.479332 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:31.479392 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 11:10:31.479432 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:10:31.480361 24922 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8504ac0a0cc046b99c642d1182e71377" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41589 } }
I20260812 11:10:31.480605 24922 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:31.480662 24922 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8504ac0a0cc046b99c642d1182e71377, State: Initialized, Role: FOLLOWER
I20260812 11:10:31.481096 24922 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8504ac0a0cc046b99c642d1182e71377" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41589 } }
I20260812 11:10:31.481230 24922 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:31.481297 24922 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:31.481398 24922 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:31.482329 24922 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8504ac0a0cc046b99c642d1182e71377" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41589 } }
I20260812 11:10:31.482661 24922 leader_election.cc:302] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8504ac0a0cc046b99c642d1182e71377; no voters:
I20260812 11:10:31.482957 24922 leader_election.cc:288] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:31.483055 24934 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:31.483292 24934 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [term 1 LEADER]: Becoming Leader. State: Replica: 8504ac0a0cc046b99c642d1182e71377, State: Running, Role: LEADER
I20260812 11:10:31.483644 24934 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8504ac0a0cc046b99c642d1182e71377" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41589 } }
I20260812 11:10:31.484179 24922 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:31.485461 24936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8504ac0a0cc046b99c642d1182e71377" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8504ac0a0cc046b99c642d1182e71377" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41589 } } }
I20260812 11:10:31.485478 24937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8504ac0a0cc046b99c642d1182e71377. Latest consensus state: current_term: 1 leader_uuid: "8504ac0a0cc046b99c642d1182e71377" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8504ac0a0cc046b99c642d1182e71377" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41589 } } }
I20260812 11:10:31.485592 24936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:31.485594 24937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:31.485951 24956 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:31.489528 24956 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:31.495416 24956 catalog_manager.cc:1347] Generated new cluster ID: 74e596d3b02646e69e514229bdbba2ed
I20260812 11:10:31.495582 24956 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:31.527120 24956 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:31.527475 24956 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:31.536970 24956 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8504ac0a0cc046b99c642d1182e71377: Generated new TSK 0
I20260812 11:10:31.537709 24956 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:31.545801 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 24809
2026-08-12T11:10:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1607 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:31 dist-test-slave-lgr5 krb5kdc[24973](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:31 dist-test-slave-lgr5 krb5kdc[24973](info): set up 2 sockets
Aug 12 11:10:31 dist-test-slave-lgr5 krb5kdc[24973](info): commencing operation
krb5kdc: starting...
W20260812 11:10:32.741942 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:32 dist-test-slave-lgr5 krb5kdc[24973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:10:32.871634 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46833
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46833
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:32.987497 25001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:32.987771 25001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:32.987813 25001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:32.991849 25001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:32.991920 25001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:32.991938 25001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:32.991953 25001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:32.991966 25001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:32.997248 25001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46833
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46833
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:32.998335 25001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:32.999322 25001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:33.008059 25010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:33.008158 25012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:33.008205 25014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:33.008277 25001 server_base.cc:1034] running on GCE node
I20260812 11:10:33.008965 25001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:33.010167 25001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:33.011332 25001 hybrid_clock.cc:648] HybridClock initialized: now 1786533033011301 us; error 44 us; skew 500 ppm
Aug 12 11:10:33 dist-test-slave-lgr5 krb5kdc[24973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533033, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:33.014230 25001 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:10:33.015182 25001 webserver.cc:460] Webserver started at http://127.0.0.1:40417/ using document root <none> and password file <none>
I20260812 11:10:33.015863 25001 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:33.015947 25001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:33.016253 25001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:33.018428 25001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "c031614cf50e4d1e80f914bc90cdc2f2"
format_stamp: "Formatted at 2026-08-12 11:10:33 on dist-test-slave-lgr5"
server_key: "f9e7f417f033113c888a70ed18112985"
server_key_iv: "f39fe206eca421c49e9a6a1caba347d3"
server_key_version: "encryptionkey@0"
I20260812 11:10:33.018998 25001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "c031614cf50e4d1e80f914bc90cdc2f2"
format_stamp: "Formatted at 2026-08-12 11:10:33 on dist-test-slave-lgr5"
server_key: "f9e7f417f033113c888a70ed18112985"
server_key_iv: "f39fe206eca421c49e9a6a1caba347d3"
server_key_version: "encryptionkey@0"
I20260812 11:10:33.023787 25001 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:10:33.029587 25033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:33.031318 25001 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.003s
I20260812 11:10:33.031492 25001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "c031614cf50e4d1e80f914bc90cdc2f2"
format_stamp: "Formatted at 2026-08-12 11:10:33 on dist-test-slave-lgr5"
server_key: "f9e7f417f033113c888a70ed18112985"
server_key_iv: "f39fe206eca421c49e9a6a1caba347d3"
server_key_version: "encryptionkey@0"
I20260812 11:10:33.031617 25001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:33.052747 25001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:33.056013 25001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:33.056218 25001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:33.062837 25001 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46833
I20260812 11:10:33.062934 25136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46833 every 8 connection(s)
I20260812 11:10:33.063802 25001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:33.066663 25141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:33.070156 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 25001
I20260812 11:10:33.070269 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:33.070518 19131 external_mini_cluster.cc:1428] Setting key d3cdde3dda193b16a2a05ac7323b03af
I20260812 11:10:33.072763 25141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2: Bootstrap starting.
I20260812 11:10:33.075559 25141 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:33.076481 25141 log.cc:824] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:33.078629 25141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2: No bootstrap required, opened a new log
Aug 12 11:10:33 dist-test-slave-lgr5 krb5kdc[24973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:10:33.082350 25141 raft_consensus.cc:348] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c031614cf50e4d1e80f914bc90cdc2f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46833 } }
I20260812 11:10:33.082690 25141 raft_consensus.cc:374] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:33.082752 25141 raft_consensus.cc:729] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c031614cf50e4d1e80f914bc90cdc2f2, State: Initialized, Role: FOLLOWER
I20260812 11:10:33.083304 25141 consensus_queue.cc:260] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c031614cf50e4d1e80f914bc90cdc2f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46833 } }
I20260812 11:10:33.083482 25141 raft_consensus.cc:388] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:33.083559 25141 raft_consensus.cc:482] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:33.083664 25141 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:33.084920 25141 raft_consensus.cc:504] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c031614cf50e4d1e80f914bc90cdc2f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46833 } }
I20260812 11:10:33.085340 25141 leader_election.cc:302] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c031614cf50e4d1e80f914bc90cdc2f2; no voters:
I20260812 11:10:33.085719 25141 leader_election.cc:288] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:33.085927 25153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:33.086160 25153 raft_consensus.cc:686] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [term 1 LEADER]: Becoming Leader. State: Replica: c031614cf50e4d1e80f914bc90cdc2f2, State: Running, Role: LEADER
I20260812 11:10:33.086531 25153 consensus_queue.cc:237] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c031614cf50e4d1e80f914bc90cdc2f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46833 } }
I20260812 11:10:33.086974 25149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:33.071949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:47635 (local address 127.0.0.1:46833)
0812 11:10:33.072395 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:33.072413 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:33.072457 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:10:33.073263 (+ 806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:33.073287 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:33.073736 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:33.074120 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:33.074762 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:33.076312 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:33.077222 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:33.077897 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:33.078057 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:33.080596 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:33.080603 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:33.080621 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:33.080656 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:33.083294 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:33.083977 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:33.083985 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:33.083991 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:33.084175 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:33.084492 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:33.084495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:33.084497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:33.085091 (+ 594us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:33.085305 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:33.085701 (+ 396us) server_negotiation.cc:299] Negotiation successful
0812 11:10:33.085959 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":142,"threads_started":1}
I20260812 11:10:33.087186 25141 sys_catalog.cc:564] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:33.088239 25156 sys_catalog.cc:455] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c031614cf50e4d1e80f914bc90cdc2f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c031614cf50e4d1e80f914bc90cdc2f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46833 } } }
I20260812 11:10:33.088374 25156 sys_catalog.cc:458] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:33.088896 25160 sys_catalog.cc:455] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c031614cf50e4d1e80f914bc90cdc2f2. Latest consensus state: current_term: 1 leader_uuid: "c031614cf50e4d1e80f914bc90cdc2f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c031614cf50e4d1e80f914bc90cdc2f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46833 } } }
I20260812 11:10:33.089058 25160 sys_catalog.cc:458] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:33.090781 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260812 11:10:33.092260 25188 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:10:33.092329 25188 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:10:33.092396 25173 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:33.094285 25173 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:33.100679 25173 catalog_manager.cc:1347] Generated new cluster ID: d3ccb02fd37544e783760937cc03b134
I20260812 11:10:33.100744 25173 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:33.105077 25149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:33.093108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:45315 (local address 127.0.0.1:46833)
0812 11:10:33.093216 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:33.093221 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:33.093416 (+ 195us) server_negotiation.cc:407] Connection header received
0812 11:10:33.093587 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:33.093591 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:33.093671 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:33.093773 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:33.094584 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:33.095384 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:33.096422 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:33.096664 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:33.096753 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:33.098104 (+ 1351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:33.098109 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:33.098111 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:33.098136 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:33.099575 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:33.100177 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:33.100181 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:33.100182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:33.100272 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:33.104184 (+ 3912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:33.104188 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:33.104190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:33.104404 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:33.104534 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:33.104831 (+ 297us) server_negotiation.cc:299] Negotiation successful
0812 11:10:33.104924 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:10:33.114074 25173 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:33.114946 25173 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:33.121091 25173 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c031614cf50e4d1e80f914bc90cdc2f2: Generated new TSK 0
I20260812 11:10:33.121788 25173 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:33.131373 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 25001
W20260812 11:10:33.151926 24968 connection.cc:535] client connection to 127.0.0.1:46833 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46833): Connection reset by peer (error 104)
2026-08-12T11:10:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1589 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:33 dist-test-slave-lgr5 krb5kdc[25209](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:33 dist-test-slave-lgr5 krb5kdc[25209](info): set up 2 sockets
Aug 12 11:10:33 dist-test-slave-lgr5 krb5kdc[25209](info): commencing operation
krb5kdc: starting...
W20260812 11:10:34.352720 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:34 dist-test-slave-lgr5 krb5kdc[25209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:10:34.479712 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40919
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:34.595747 25232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:34.596063 25232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:34.596148 25232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:34.600296 25232 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:34.600379 25232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:34.600404 25232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:34.600427 25232 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:34.600456 25232 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:34.606112 25232 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:34.607259 25232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:34.608353 25232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:34.617848 25247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:34.617909 25244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:34.618221 25232 server_base.cc:1034] running on GCE node
W20260812 11:10:34.617856 25245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:34.618933 25232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:34.620174 25232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:34.621337 25232 hybrid_clock.cc:648] HybridClock initialized: now 1786533034621315 us; error 38 us; skew 500 ppm
Aug 12 11:10:34 dist-test-slave-lgr5 krb5kdc[25209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533034, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:34.624200 25232 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:10:34.625172 25232 webserver.cc:460] Webserver started at http://127.0.0.1:39893/ using document root <none> and password file <none>
I20260812 11:10:34.625731 25232 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:34.625793 25232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:34.625980 25232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:34.628190 25232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "6703d18c75d447ee87f8cc67be37c2b7"
format_stamp: "Formatted at 2026-08-12 11:10:34 on dist-test-slave-lgr5"
server_key: "5361008eea148179c5e6779241e57038"
server_key_iv: "9c9804d8f1dd5f92df7d3474d1971ddf"
server_key_version: "encryptionkey@0"
I20260812 11:10:34.628723 25232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "6703d18c75d447ee87f8cc67be37c2b7"
format_stamp: "Formatted at 2026-08-12 11:10:34 on dist-test-slave-lgr5"
server_key: "5361008eea148179c5e6779241e57038"
server_key_iv: "9c9804d8f1dd5f92df7d3474d1971ddf"
server_key_version: "encryptionkey@0"
I20260812 11:10:34.632694 25232 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:10:34.635511 25259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:34.637055 25232 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:34.637300 25232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "6703d18c75d447ee87f8cc67be37c2b7"
format_stamp: "Formatted at 2026-08-12 11:10:34 on dist-test-slave-lgr5"
server_key: "5361008eea148179c5e6779241e57038"
server_key_iv: "9c9804d8f1dd5f92df7d3474d1971ddf"
server_key_version: "encryptionkey@0"
I20260812 11:10:34.637426 25232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:34.673188 25232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:34.676345 25232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:34.676522 25232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:34.683513 25232 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40919
I20260812 11:10:34.683539 25355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40919 every 8 connection(s)
I20260812 11:10:34.684499 25232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:34.687285 25356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:34.688184 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 25232
I20260812 11:10:34.688299 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:34.688549 19131 external_mini_cluster.cc:1428] Setting key 794b2aa4c03eab53efcc5db86bcf5a12
I20260812 11:10:34.694175 25356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7: Bootstrap starting.
I20260812 11:10:34.696897 25356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:34.697835 25356 log.cc:824] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:34.698576 25360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:34.689916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:43741 (local address 127.0.0.1:40919)
0812 11:10:34.690349 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:34.690368 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:34.690413 (+ 45us) server_negotiation.cc:407] Connection header received
0812 11:10:34.691232 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:34.691258 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:34.691721 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:34.692128 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:34.692560 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:34.694010 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:34.694917 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:34.695637 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:34.695801 (+ 164us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:34.696588 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:34.696594 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:34.696612 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:34.697126 (+ 514us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:34.697202 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:34.697235 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:34.697371 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:34.697537 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 11:10:34.697681 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":94,"threads_started":1}
I20260812 11:10:34.700045 25356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7: No bootstrap required, opened a new log
I20260812 11:10:34.701694 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:34.704618 25356 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6703d18c75d447ee87f8cc67be37c2b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40919 } }
I20260812 11:10:34.704941 25356 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:34.705024 25356 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6703d18c75d447ee87f8cc67be37c2b7, State: Initialized, Role: FOLLOWER
I20260812 11:10:34.705487 25356 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6703d18c75d447ee87f8cc67be37c2b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40919 } }
I20260812 11:10:34.705655 25356 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:34.705725 25356 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:34.705829 25356 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:34.706990 25356 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6703d18c75d447ee87f8cc67be37c2b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40919 } }
I20260812 11:10:34.707394 25356 leader_election.cc:302] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6703d18c75d447ee87f8cc67be37c2b7; no voters:
I20260812 11:10:34.707808 25356 leader_election.cc:288] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:34.707898 25369 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:34.708129 25360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:34.703993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:35301 (local address 127.0.0.1:40919)
0812 11:10:34.704142 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:34.704146 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:34.704337 (+ 191us) server_negotiation.cc:407] Connection header received
0812 11:10:34.704468 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:34.704471 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:34.704514 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:34.704567 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:34.704868 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:34.705438 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:34.706490 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:34.706735 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:34.706813 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:34.707645 (+ 832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:34.707647 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:34.707650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:34.707662 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:34.707688 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:34.707698 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:34.707766 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:34.707918 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 11:10:34.707976 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:10:34.708212 25369 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [term 1 LEADER]: Becoming Leader. State: Replica: 6703d18c75d447ee87f8cc67be37c2b7, State: Running, Role: LEADER
I20260812 11:10:34.708585 25369 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6703d18c75d447ee87f8cc67be37c2b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40919 } }
I20260812 11:10:34.709342 25356 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:34.709865 25369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6703d18c75d447ee87f8cc67be37c2b7. Latest consensus state: current_term: 1 leader_uuid: "6703d18c75d447ee87f8cc67be37c2b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6703d18c75d447ee87f8cc67be37c2b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40919 } } }
I20260812 11:10:34.710049 25369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:34.710314 25371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6703d18c75d447ee87f8cc67be37c2b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6703d18c75d447ee87f8cc67be37c2b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40919 } } }
I20260812 11:10:34.710462 25371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:34.710505 25380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:34.713963 25380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:34.719806 25380 catalog_manager.cc:1347] Generated new cluster ID: 23b2c3b81f91481aa6c426506f59370d
I20260812 11:10:34.719882 25380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:34.733443 25380 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:34.734781 25380 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:34.745121 25380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6703d18c75d447ee87f8cc67be37c2b7: Generated new TSK 0
I20260812 11:10:34.746059 25380 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:34.755923 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 25232
W20260812 11:10:34.770488 25205 connection.cc:535] client connection to 127.0.0.1:40919 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40919): Connection reset by peer (error 104)
2026-08-12T11:10:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1618 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:34 dist-test-slave-lgr5 krb5kdc[25411](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:34 dist-test-slave-lgr5 krb5kdc[25411](info): set up 2 sockets
Aug 12 11:10:34 dist-test-slave-lgr5 krb5kdc[25411](info): commencing operation
krb5kdc: starting...
W20260812 11:10:35.958081 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:36 dist-test-slave-lgr5 krb5kdc[25411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:10:36.087057 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43609
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43609
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:36.201596 25431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:36.201906 25431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:36.201972 25431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:36.206108 25431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:36.206185 25431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:36.206213 25431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:36.206236 25431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:36.206265 25431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:36.212206 25431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:36.213413 25431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:36.214501 25431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:36.223203 25440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:36.223346 25431 server_base.cc:1034] running on GCE node
W20260812 11:10:36.223232 25444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:36.223568 25441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:36.224174 25431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:36.225311 25431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:36.226471 25431 hybrid_clock.cc:648] HybridClock initialized: now 1786533036226457 us; error 30 us; skew 500 ppm
Aug 12 11:10:36 dist-test-slave-lgr5 krb5kdc[25411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533036, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:36.229233 25431 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:10:36.230129 25431 webserver.cc:460] Webserver started at http://127.0.0.1:43781/ using document root <none> and password file <none>
I20260812 11:10:36.230671 25431 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:36.230731 25431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:36.230904 25431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:36.233089 25431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "64d7263bb23b4e4d8793d24f08e83af4"
format_stamp: "Formatted at 2026-08-12 11:10:36 on dist-test-slave-lgr5"
server_key: "20541d4e6ea3d3dcc3acf637349552a0"
server_key_iv: "df6d11658e8314a334e8044097dd7d12"
server_key_version: "encryptionkey@0"
I20260812 11:10:36.233703 25431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "64d7263bb23b4e4d8793d24f08e83af4"
format_stamp: "Formatted at 2026-08-12 11:10:36 on dist-test-slave-lgr5"
server_key: "20541d4e6ea3d3dcc3acf637349552a0"
server_key_iv: "df6d11658e8314a334e8044097dd7d12"
server_key_version: "encryptionkey@0"
I20260812 11:10:36.237751 25431 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:10:36.240291 25453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:36.241650 25431 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:36.241765 25431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "64d7263bb23b4e4d8793d24f08e83af4"
format_stamp: "Formatted at 2026-08-12 11:10:36 on dist-test-slave-lgr5"
server_key: "20541d4e6ea3d3dcc3acf637349552a0"
server_key_iv: "df6d11658e8314a334e8044097dd7d12"
server_key_version: "encryptionkey@0"
I20260812 11:10:36.241873 25431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:36.246788 25431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:36.250104 25431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:36.250254 25431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:36.257211 25431 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43609
I20260812 11:10:36.257254 25559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43609 every 8 connection(s)
I20260812 11:10:36.258152 25431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:36.261103 25560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:36.263866 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 25431
I20260812 11:10:36.263978 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:36.264256 19131 external_mini_cluster.cc:1428] Setting key 0a7e37644489f9f6e986dc1d1ebf788a
I20260812 11:10:36.267288 25560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4: Bootstrap starting.
I20260812 11:10:36.269702 25564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:36.265700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:49351 (local address 127.0.0.1:43609)
0812 11:10:36.266297 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:36.266316 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:36.266360 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:10:36.267081 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:36.267099 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:36.267381 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:36.267728 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:36.268509 (+ 781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:36.268515 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:36.268526 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:36.268537 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:36.268589 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:36.268609 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:36.268744 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:36.268813 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 11:10:36.268971 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":165,"threads_started":1}
I20260812 11:10:36.269727 25560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:36.270466 25560 log.cc:824] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:36.272375 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:36.272553 25560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4: No bootstrap required, opened a new log
I20260812 11:10:36.275851 25564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:36.274264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:42861 (local address 127.0.0.1:43609)
0812 11:10:36.274400 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:36.274405 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:36.274596 (+ 191us) server_negotiation.cc:407] Connection header received
0812 11:10:36.274703 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:36.274706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:36.274737 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:36.274800 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:36.275497 (+ 697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:36.275501 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:36.275504 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:36.275516 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:36.275541 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:36.275550 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:36.275620 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:36.275692 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 11:10:36.275733 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:10:36.276486 25560 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d7263bb23b4e4d8793d24f08e83af4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43609 } }
I20260812 11:10:36.276773 25560 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:36.276849 25560 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64d7263bb23b4e4d8793d24f08e83af4, State: Initialized, Role: FOLLOWER
I20260812 11:10:36.277314 25560 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d7263bb23b4e4d8793d24f08e83af4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43609 } }
I20260812 11:10:36.277458 25560 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:36.277525 25560 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:36.277626 25560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:36.278582 25560 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d7263bb23b4e4d8793d24f08e83af4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43609 } }
I20260812 11:10:36.278930 25560 leader_election.cc:302] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64d7263bb23b4e4d8793d24f08e83af4; no voters:
I20260812 11:10:36.279263 25560 leader_election.cc:288] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:36.279367 25577 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:36.279596 25577 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [term 1 LEADER]: Becoming Leader. State: Replica: 64d7263bb23b4e4d8793d24f08e83af4, State: Running, Role: LEADER
I20260812 11:10:36.279942 25577 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d7263bb23b4e4d8793d24f08e83af4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43609 } }
I20260812 11:10:36.280568 25560 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:36.281726 25580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64d7263bb23b4e4d8793d24f08e83af4. Latest consensus state: current_term: 1 leader_uuid: "64d7263bb23b4e4d8793d24f08e83af4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d7263bb23b4e4d8793d24f08e83af4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43609 } } }
I20260812 11:10:36.281764 25578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64d7263bb23b4e4d8793d24f08e83af4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d7263bb23b4e4d8793d24f08e83af4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43609 } } }
I20260812 11:10:36.281864 25578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:36.281864 25580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:36.283169 25592 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:36.286484 25592 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:36.292852 25592 catalog_manager.cc:1347] Generated new cluster ID: 039ec55b2c924563837f8f885367edcc
I20260812 11:10:36.292939 25592 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:36.323669 25592 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:36.324051 25592 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:36.333987 25592 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64d7263bb23b4e4d8793d24f08e83af4: Generated new TSK 0
I20260812 11:10:36.334928 25592 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:36.345731 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 25431
2026-08-12T11:10:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1590 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:36 dist-test-slave-lgr5 krb5kdc[25615](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:36 dist-test-slave-lgr5 krb5kdc[25615](info): set up 2 sockets
Aug 12 11:10:36 dist-test-slave-lgr5 krb5kdc[25615](info): commencing operation
krb5kdc: starting...
W20260812 11:10:37.541800 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:37 dist-test-slave-lgr5 krb5kdc[25615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:10:37.666831 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46239
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:37.778808 25645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:37.779088 25645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:37.779130 25645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:37.783109 25645 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:37.783174 25645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:37.783193 25645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:37.783208 25645 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:37.783221 25645 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:37.788733 25645 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46239
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:37.789817 25645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:37.790807 25645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:10:37.799568 25645 server_base.cc:1034] running on GCE node
W20260812 11:10:37.799500 25658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:37.799468 25655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:37.799472 25653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:37.800402 25645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:37.801512 25645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:37.802701 25645 hybrid_clock.cc:648] HybridClock initialized: now 1786533037802673 us; error 39 us; skew 500 ppm
Aug 12 11:10:37 dist-test-slave-lgr5 krb5kdc[25615](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533037, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:37.809504 25645 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:10:37.810555 25645 webserver.cc:460] Webserver started at http://127.0.0.1:34029/ using document root <none> and password file <none>
I20260812 11:10:37.811129 25645 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:37.811199 25645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:37.811414 25645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:37.813570 25645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "a237dea2f4ef4f13b5348c999df7edde"
format_stamp: "Formatted at 2026-08-12 11:10:37 on dist-test-slave-lgr5"
server_key: "6286a140a27db4eec282dee99223bf5a"
server_key_iv: "0c94aa30121a45073c54c3e1f6974649"
server_key_version: "encryptionkey@0"
I20260812 11:10:37.814119 25645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "a237dea2f4ef4f13b5348c999df7edde"
format_stamp: "Formatted at 2026-08-12 11:10:37 on dist-test-slave-lgr5"
server_key: "6286a140a27db4eec282dee99223bf5a"
server_key_iv: "0c94aa30121a45073c54c3e1f6974649"
server_key_version: "encryptionkey@0"
I20260812 11:10:37.817952 25645 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:10:37.820492 25668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:37.821727 25645 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:37.821859 25645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "a237dea2f4ef4f13b5348c999df7edde"
format_stamp: "Formatted at 2026-08-12 11:10:37 on dist-test-slave-lgr5"
server_key: "6286a140a27db4eec282dee99223bf5a"
server_key_iv: "0c94aa30121a45073c54c3e1f6974649"
server_key_version: "encryptionkey@0"
I20260812 11:10:37.821970 25645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:37.838864 25645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:37.841768 25645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:37.841966 25645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:37.848927 25645 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46239
I20260812 11:10:37.848941 25771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46239 every 8 connection(s)
I20260812 11:10:37.849905 25645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:37.852969 25772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:37.853647 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 25645
I20260812 11:10:37.853814 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:37.854090 19131 external_mini_cluster.cc:1428] Setting key 48ac8b6a88579ec4e8a8f4c3b8099570
I20260812 11:10:37.859675 25772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde: Bootstrap starting.
I20260812 11:10:37.862464 25772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:37.863257 25772 log.cc:824] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:10:37 dist-test-slave-lgr5 krb5kdc[25615](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:10:37.865621 25772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde: No bootstrap required, opened a new log
I20260812 11:10:37.869148 25775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:37.855556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:36477 (local address 127.0.0.1:46239)
0812 11:10:37.856011 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:37.856031 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:37.856106 (+ 75us) server_negotiation.cc:407] Connection header received
0812 11:10:37.856914 (+ 808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:37.856952 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:37.857385 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:37.857750 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:37.858399 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:37.859880 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:37.860737 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:37.861411 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:37.861574 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:37.864187 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:37.864193 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:37.864209 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:37.864239 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:37.866081 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:37.866562 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:37.866568 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:37.866573 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:37.866713 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:37.866976 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:37.866980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:37.866981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:37.867485 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:37.867704 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:37.867915 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 11:10:37.868194 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":128,"threads_started":1}
I20260812 11:10:37.869967 25772 raft_consensus.cc:348] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a237dea2f4ef4f13b5348c999df7edde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46239 } }
I20260812 11:10:37.870183 25772 raft_consensus.cc:374] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:37.870240 25772 raft_consensus.cc:729] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a237dea2f4ef4f13b5348c999df7edde, State: Initialized, Role: FOLLOWER
I20260812 11:10:37.870668 25772 consensus_queue.cc:260] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a237dea2f4ef4f13b5348c999df7edde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46239 } }
I20260812 11:10:37.870790 25772 raft_consensus.cc:388] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:37.870895 25772 raft_consensus.cc:482] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:37.870997 25772 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:37.871918 25772 raft_consensus.cc:504] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a237dea2f4ef4f13b5348c999df7edde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46239 } }
I20260812 11:10:37.872045 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:37.872298 25772 leader_election.cc:302] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a237dea2f4ef4f13b5348c999df7edde; no voters:
I20260812 11:10:37.872671 25772 leader_election.cc:288] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:37.872756 25777 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:37.872992 25777 raft_consensus.cc:686] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [term 1 LEADER]: Becoming Leader. State: Replica: a237dea2f4ef4f13b5348c999df7edde, State: Running, Role: LEADER
I20260812 11:10:37.873354 25777 consensus_queue.cc:237] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a237dea2f4ef4f13b5348c999df7edde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46239 } }
I20260812 11:10:37.874081 25772 sys_catalog.cc:564] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:37.875015 25781 sys_catalog.cc:455] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [sys.catalog]: SysCatalogTable state changed. Reason: New leader a237dea2f4ef4f13b5348c999df7edde. Latest consensus state: current_term: 1 leader_uuid: "a237dea2f4ef4f13b5348c999df7edde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a237dea2f4ef4f13b5348c999df7edde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46239 } } }
I20260812 11:10:37.875144 25781 sys_catalog.cc:458] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:37.875447 25778 sys_catalog.cc:455] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a237dea2f4ef4f13b5348c999df7edde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a237dea2f4ef4f13b5348c999df7edde" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46239 } } }
I20260812 11:10:37.875541 25778 sys_catalog.cc:458] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:37.875989 25804 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:37.879963 25804 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:37.884280 25775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:37.874332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:53953 (local address 127.0.0.1:46239)
0812 11:10:37.874448 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:37.874453 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:37.874704 (+ 251us) server_negotiation.cc:407] Connection header received
0812 11:10:37.875035 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:37.875039 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:37.875129 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:37.875192 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:37.876209 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:37.876959 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:37.878210 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:37.878532 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:37.878640 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:37.880308 (+ 1668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:37.880312 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:37.880315 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:37.880342 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:37.881986 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:37.882628 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:37.882632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:37.882633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:37.882726 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:37.883158 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:37.883161 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:37.883163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:37.883394 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:37.883513 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:37.883967 (+ 454us) server_negotiation.cc:299] Negotiation successful
0812 11:10:37.884114 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:10:37.885619 25804 catalog_manager.cc:1347] Generated new cluster ID: 04de2ffec9cb4d6ab678f87c6572c137
I20260812 11:10:37.885681 25804 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:37.896863 25804 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:37.897872 25804 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:37.907305 25804 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a237dea2f4ef4f13b5348c999df7edde: Generated new TSK 0
I20260812 11:10:37.908228 25804 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:37.915740 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 25645
W20260812 11:10:37.941499 25613 connection.cc:535] client connection to 127.0.0.1:46239 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46239): Connection reset by peer (error 104)
2026-08-12T11:10:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1582 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:37 dist-test-slave-lgr5 krb5kdc[25824](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:37 dist-test-slave-lgr5 krb5kdc[25824](info): set up 2 sockets
Aug 12 11:10:37 dist-test-slave-lgr5 krb5kdc[25824](info): commencing operation
krb5kdc: starting...
W20260812 11:10:39.131315 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:39 dist-test-slave-lgr5 krb5kdc[25824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533039, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:10:39.252516 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37729
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37729
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:39.368000 25843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:39.368345 25843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:39.368407 25843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:39.372836 25843 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:39.372922 25843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:39.372951 25843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:39.372972 25843 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:39.373003 25843 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:39.379266 25843 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37729
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:39.380523 25843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:39.381768 25843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:39.391103 25855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:39.391204 25843 server_base.cc:1034] running on GCE node
W20260812 11:10:39.391235 25854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:39.391108 25859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:39.392138 25843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:39.393338 25843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:39.394532 25843 hybrid_clock.cc:648] HybridClock initialized: now 1786533039394515 us; error 29 us; skew 500 ppm
Aug 12 11:10:39 dist-test-slave-lgr5 krb5kdc[25824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533039, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:39.397709 25843 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:10:39.398743 25843 webserver.cc:460] Webserver started at http://127.0.0.1:40589/ using document root <none> and password file <none>
I20260812 11:10:39.399320 25843 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:39.399390 25843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:39.399631 25843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:39.401902 25843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "d4766f4717c8439b8006b4c02e57ca0d"
format_stamp: "Formatted at 2026-08-12 11:10:39 on dist-test-slave-lgr5"
server_key: "d7de545285a07026008a47d56b84de03"
server_key_iv: "6cbbc175df2deb8cc5452894781e6b97"
server_key_version: "encryptionkey@0"
I20260812 11:10:39.402498 25843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "d4766f4717c8439b8006b4c02e57ca0d"
format_stamp: "Formatted at 2026-08-12 11:10:39 on dist-test-slave-lgr5"
server_key: "d7de545285a07026008a47d56b84de03"
server_key_iv: "6cbbc175df2deb8cc5452894781e6b97"
server_key_version: "encryptionkey@0"
I20260812 11:10:39.406627 25843 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:10:39.409559 25869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:39.410900 25843 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:10:39.411048 25843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "d4766f4717c8439b8006b4c02e57ca0d"
format_stamp: "Formatted at 2026-08-12 11:10:39 on dist-test-slave-lgr5"
server_key: "d7de545285a07026008a47d56b84de03"
server_key_iv: "6cbbc175df2deb8cc5452894781e6b97"
server_key_version: "encryptionkey@0"
I20260812 11:10:39.411163 25843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:39.432432 25843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:39.435739 25843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:39.435963 25843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:39.443723 25843 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37729
I20260812 11:10:39.443742 25955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37729 every 8 connection(s)
I20260812 11:10:39.444832 25843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:39.447801 25956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:39.449702 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 25843
I20260812 11:10:39.449829 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:39.450103 19131 external_mini_cluster.cc:1428] Setting key fdf47e78af8a5a0c2aa06dff41aef429
I20260812 11:10:39.455171 25956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d: Bootstrap starting.
I20260812 11:10:39.457957 25956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:39.458804 25956 log.cc:824] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:39.460279 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:39.451649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:55247 (local address 127.0.0.1:37729)
0812 11:10:39.452169 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:39.452193 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:39.452241 (+ 48us) server_negotiation.cc:407] Connection header received
0812 11:10:39.453097 (+ 856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:39.453126 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:39.453610 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:39.454023 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:39.454453 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:39.455872 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:39.456793 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:39.457488 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:39.457650 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:39.458474 (+ 824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:39.458479 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:39.458493 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:39.458881 (+ 388us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:39.458952 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:39.458984 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:39.459093 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:39.459310 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 11:10:39.459485 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":133,"threads_started":1}
I20260812 11:10:39.460879 25956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d: No bootstrap required, opened a new log
I20260812 11:10:39.463239 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:39.464926 25956 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4766f4717c8439b8006b4c02e57ca0d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37729 } }
I20260812 11:10:39.465233 25956 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:39.465301 25956 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4766f4717c8439b8006b4c02e57ca0d, State: Initialized, Role: FOLLOWER
I20260812 11:10:39.465734 25956 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4766f4717c8439b8006b4c02e57ca0d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37729 } }
I20260812 11:10:39.465874 25956 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:39.465941 25956 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:39.466046 25956 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:39.466960 25956 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4766f4717c8439b8006b4c02e57ca0d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37729 } }
I20260812 11:10:39.467293 25956 leader_election.cc:302] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4766f4717c8439b8006b4c02e57ca0d; no voters:
I20260812 11:10:39.467602 25956 leader_election.cc:288] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:39.467684 25973 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:39.467864 25973 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [term 1 LEADER]: Becoming Leader. State: Replica: d4766f4717c8439b8006b4c02e57ca0d, State: Running, Role: LEADER
I20260812 11:10:39.468258 25973 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4766f4717c8439b8006b4c02e57ca0d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37729 } }
I20260812 11:10:39.469012 25956 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:39.469198 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:39.465212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:60509 (local address 127.0.0.1:37729)
0812 11:10:39.465317 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:39.465321 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:39.465574 (+ 253us) server_negotiation.cc:407] Connection header received
0812 11:10:39.465670 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:39.465673 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:39.465716 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:39.465776 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:39.466024 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:39.466557 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:39.467368 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:39.467647 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:39.467742 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:39.468760 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:39.468763 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:39.468766 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:39.468780 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:39.468809 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:39.468820 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:39.468889 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:39.469036 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 11:10:39.469071 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:10:39.470700 25979 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4766f4717c8439b8006b4c02e57ca0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4766f4717c8439b8006b4c02e57ca0d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37729 } } }
I20260812 11:10:39.470841 25979 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:39.471508 26006 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:39.471606 25976 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4766f4717c8439b8006b4c02e57ca0d. Latest consensus state: current_term: 1 leader_uuid: "d4766f4717c8439b8006b4c02e57ca0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4766f4717c8439b8006b4c02e57ca0d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37729 } } }
I20260812 11:10:39.471711 25976 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:39.474236 26006 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:39.479583 26006 catalog_manager.cc:1347] Generated new cluster ID: 0d8900fa30aa49b4adf282250513ded2
I20260812 11:10:39.479664 26006 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:39.486317 26006 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:39.487659 26006 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:39.492643 26006 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4766f4717c8439b8006b4c02e57ca0d: Generated new TSK 0
I20260812 11:10:39.493551 26006 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:39.497474 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 25843
W20260812 11:10:39.520545 25821 connection.cc:535] client connection to 127.0.0.1:37729 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37729): Connection reset by peer (error 104)
2026-08-12T11:10:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1576 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:39 dist-test-slave-lgr5 krb5kdc[26020](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:39 dist-test-slave-lgr5 krb5kdc[26020](info): set up 2 sockets
Aug 12 11:10:39 dist-test-slave-lgr5 krb5kdc[26020](info): commencing operation
krb5kdc: starting...
W20260812 11:10:40.701197 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:40 dist-test-slave-lgr5 krb5kdc[26020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:10:40.826949 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36781
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36781
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:40.938421 26045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:40.938683 26045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:40.938723 26045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:40.942693 26045 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:40.942754 26045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:40.942771 26045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:40.942786 26045 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:40.942799 26045 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:40.948024 26045 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36781
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:40.949071 26045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:40.950052 26045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:40.958698 26053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:40.958705 26055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:40.958705 26051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:40.958774 26045 server_base.cc:1034] running on GCE node
I20260812 11:10:40.959666 26045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:40.960882 26045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:40.962072 26045 hybrid_clock.cc:648] HybridClock initialized: now 1786533040962050 us; error 32 us; skew 500 ppm
Aug 12 11:10:40 dist-test-slave-lgr5 krb5kdc[26020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533040, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:40.964784 26045 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:10:40.965670 26045 webserver.cc:460] Webserver started at http://127.0.0.1:37141/ using document root <none> and password file <none>
I20260812 11:10:40.966327 26045 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:40.966419 26045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:40.966650 26045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:40.968792 26045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "666c9f23d9144331961687f95d2d5489"
format_stamp: "Formatted at 2026-08-12 11:10:40 on dist-test-slave-lgr5"
server_key: "96820f68e4a0eee337a5484ae5aac4ae"
server_key_iv: "0a5a234b8c99d2e4a79988ac5126d949"
server_key_version: "encryptionkey@0"
I20260812 11:10:40.969331 26045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "666c9f23d9144331961687f95d2d5489"
format_stamp: "Formatted at 2026-08-12 11:10:40 on dist-test-slave-lgr5"
server_key: "96820f68e4a0eee337a5484ae5aac4ae"
server_key_iv: "0a5a234b8c99d2e4a79988ac5126d949"
server_key_version: "encryptionkey@0"
I20260812 11:10:40.973326 26045 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:10:40.975718 26066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:40.976951 26045 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:40.977064 26045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "666c9f23d9144331961687f95d2d5489"
format_stamp: "Formatted at 2026-08-12 11:10:40 on dist-test-slave-lgr5"
server_key: "96820f68e4a0eee337a5484ae5aac4ae"
server_key_iv: "0a5a234b8c99d2e4a79988ac5126d949"
server_key_version: "encryptionkey@0"
I20260812 11:10:40.977164 26045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:40.981637 26045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:40.984582 26045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:40.984742 26045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:40.991277 26045 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36781
I20260812 11:10:40.991351 26153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36781 every 8 connection(s)
I20260812 11:10:40.992223 26045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:40.993521 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 26045
I20260812 11:10:40.993628 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:40.993897 19131 external_mini_cluster.cc:1428] Setting key bca82542ce8ac4c91d8f6260cf80ee84
I20260812 11:10:40.995353 26154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:40.998908 26158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.995200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:48213 (local address 127.0.0.1:36781)
0812 11:10:40.995586 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:40.995601 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:40.995638 (+ 37us) server_negotiation.cc:407] Connection header received
0812 11:10:40.996300 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:40.996319 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:40.996638 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:40.996918 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:40.997745 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:40.997750 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:40.997762 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:40.997772 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:40.997824 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:40.997842 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:40.997945 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:40.998041 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 11:10:40.998182 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":104,"threads_started":1}
I20260812 11:10:41.001724 26154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489: Bootstrap starting.
I20260812 11:10:41.002002 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:41.004201 26154 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:41.005002 26154 log.cc:824] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:41.005625 26158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:41.003960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.158:54247 (local address 127.0.0.1:36781)
0812 11:10:41.004059 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:41.004064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:41.004324 (+ 260us) server_negotiation.cc:407] Connection header received
0812 11:10:41.004403 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:41.004407 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:41.004443 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:41.004505 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:41.005235 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:41.005238 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:41.005241 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:41.005254 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:41.005282 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:41.005295 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:41.005384 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:41.005488 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 11:10:41.005523 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 11:10:41.007186 26154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489: No bootstrap required, opened a new log
I20260812 11:10:41.010756 26154 raft_consensus.cc:348] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666c9f23d9144331961687f95d2d5489" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36781 } }
I20260812 11:10:41.011014 26154 raft_consensus.cc:374] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:41.011076 26154 raft_consensus.cc:729] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666c9f23d9144331961687f95d2d5489, State: Initialized, Role: FOLLOWER
I20260812 11:10:41.011548 26154 consensus_queue.cc:260] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666c9f23d9144331961687f95d2d5489" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36781 } }
I20260812 11:10:41.011687 26154 raft_consensus.cc:388] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:41.011736 26154 raft_consensus.cc:482] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:41.011811 26154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:41.012725 26154 raft_consensus.cc:504] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666c9f23d9144331961687f95d2d5489" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36781 } }
I20260812 11:10:41.013031 26154 leader_election.cc:302] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 666c9f23d9144331961687f95d2d5489; no voters:
I20260812 11:10:41.013307 26154 leader_election.cc:288] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:41.013432 26166 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:41.013640 26166 raft_consensus.cc:686] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [term 1 LEADER]: Becoming Leader. State: Replica: 666c9f23d9144331961687f95d2d5489, State: Running, Role: LEADER
I20260812 11:10:41.013978 26166 consensus_queue.cc:237] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666c9f23d9144331961687f95d2d5489" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36781 } }
I20260812 11:10:41.014482 26154 sys_catalog.cc:564] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:41.015648 26168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 666c9f23d9144331961687f95d2d5489. Latest consensus state: current_term: 1 leader_uuid: "666c9f23d9144331961687f95d2d5489" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666c9f23d9144331961687f95d2d5489" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36781 } } }
I20260812 11:10:41.015655 26167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "666c9f23d9144331961687f95d2d5489" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "666c9f23d9144331961687f95d2d5489" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36781 } } }
I20260812 11:10:41.015832 26167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:41.015820 26168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:41.016319 26186 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:41.019245 26186 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:41.024389 26186 catalog_manager.cc:1347] Generated new cluster ID: eee4ac699fbe40e1aff38642180e9e92
I20260812 11:10:41.024464 26186 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:41.055851 26186 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:41.056308 26186 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:41.066428 26186 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 666c9f23d9144331961687f95d2d5489: Generated new TSK 0
I20260812 11:10:41.067338 26186 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:41.076982 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 26045
2026-08-12T11:10:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1569 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:41 dist-test-slave-lgr5 krb5kdc[26207](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:41 dist-test-slave-lgr5 krb5kdc[26207](info): set up 2 sockets
Aug 12 11:10:41 dist-test-slave-lgr5 krb5kdc[26207](info): commencing operation
krb5kdc: starting...
W20260812 11:10:42.265563 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:42 dist-test-slave-lgr5 krb5kdc[26207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:10:42.391803 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:43167
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:40015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:43167
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:42.506872 26229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:42.507131 26229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:42.507172 26229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:42.511188 26229 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:42.511251 26229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:42.511269 26229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:42.511286 26229 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:42.511312 26229 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:42.516515 26229 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:40015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:43167
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:43167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:42.517477 26229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:42.518421 26229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:10:42.526808 26229 server_base.cc:1034] running on GCE node
W20260812 11:10:42.526760 26238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:42.526755 26234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:42.526753 26235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:42.527585 26229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:42.528707 26229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:42.529877 26229 hybrid_clock.cc:648] HybridClock initialized: now 1786533042529844 us; error 41 us; skew 500 ppm
Aug 12 11:10:42 dist-test-slave-lgr5 krb5kdc[26207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533042, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:42.532562 26229 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:10:42.533407 26229 webserver.cc:460] Webserver started at http://127.18.174.254:35167/ using document root <none> and password file <none>
I20260812 11:10:42.533941 26229 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:42.534003 26229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:42.534219 26229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:42.536296 26229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "87263f1d98f24c7d914b481d2ce7e3bc"
format_stamp: "Formatted at 2026-08-12 11:10:42 on dist-test-slave-lgr5"
server_key: "f9af4630b75b7497f13ab92fc10e95f8"
server_key_iv: "99ed54f7122be159dbbd32f5f7313da1"
server_key_version: "encryptionkey@0"
I20260812 11:10:42.536859 26229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "87263f1d98f24c7d914b481d2ce7e3bc"
format_stamp: "Formatted at 2026-08-12 11:10:42 on dist-test-slave-lgr5"
server_key: "f9af4630b75b7497f13ab92fc10e95f8"
server_key_iv: "99ed54f7122be159dbbd32f5f7313da1"
server_key_version: "encryptionkey@0"
I20260812 11:10:42.540688 26229 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:10:42.543031 26252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:42.544315 26229 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:42.544461 26229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "87263f1d98f24c7d914b481d2ce7e3bc"
format_stamp: "Formatted at 2026-08-12 11:10:42 on dist-test-slave-lgr5"
server_key: "f9af4630b75b7497f13ab92fc10e95f8"
server_key_iv: "99ed54f7122be159dbbd32f5f7313da1"
server_key_version: "encryptionkey@0"
I20260812 11:10:42.544572 26229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:42.559785 26229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:42.562784 26229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:42.562945 26229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:42.569861 26229 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:43167
I20260812 11:10:42.569904 26333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:43167 every 8 connection(s)
I20260812 11:10:42.570822 26229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:42.573671 26334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:42.579034 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 26229
I20260812 11:10:42.579175 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:42.579263 26334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc: Bootstrap starting.
I20260812 11:10:42.579496 19131 external_mini_cluster.cc:1428] Setting key d3856c1a9d715ebddb109305eb24bfd2
I20260812 11:10:42.581935 26334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:42.582661 26334 log.cc:824] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:42.584585 26334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc: No bootstrap required, opened a new log
I20260812 11:10:42.588135 26334 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87263f1d98f24c7d914b481d2ce7e3bc" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 43167 } }
I20260812 11:10:42.588368 26334 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
Aug 12 11:10:42 dist-test-slave-lgr5 krb5kdc[26207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:42.588436 26334 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87263f1d98f24c7d914b481d2ce7e3bc, State: Initialized, Role: FOLLOWER
I20260812 11:10:42.588971 26334 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87263f1d98f24c7d914b481d2ce7e3bc" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 43167 } }
I20260812 11:10:42.589138 26334 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:42.589200 26334 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:42.589298 26334 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:42.590342 26334 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87263f1d98f24c7d914b481d2ce7e3bc" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 43167 } }
I20260812 11:10:42.590682 26334 leader_election.cc:302] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87263f1d98f24c7d914b481d2ce7e3bc; no voters:
I20260812 11:10:42.590986 26334 leader_election.cc:288] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:42.591077 26340 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:42.591235 26340 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [term 1 LEADER]: Becoming Leader. State: Replica: 87263f1d98f24c7d914b481d2ce7e3bc, State: Running, Role: LEADER
I20260812 11:10:42.591590 26340 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87263f1d98f24c7d914b481d2ce7e3bc" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 43167 } }
I20260812 11:10:42.592351 26334 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:42.593262 26342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87263f1d98f24c7d914b481d2ce7e3bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87263f1d98f24c7d914b481d2ce7e3bc" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 43167 } } }
I20260812 11:10:42.593393 26342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:42.593699 26349 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87263f1d98f24c7d914b481d2ce7e3bc. Latest consensus state: current_term: 1 leader_uuid: "87263f1d98f24c7d914b481d2ce7e3bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87263f1d98f24c7d914b481d2ce7e3bc" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 43167 } } }
I20260812 11:10:42.593787 26349 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:42.594205 26368 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:42.595156 26337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:42.580948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49849 (local address 127.18.174.254:43167)
0812 11:10:42.581407 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:42.581423 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:42.581458 (+ 35us) server_negotiation.cc:407] Connection header received
0812 11:10:42.582153 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:42.582173 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:42.582536 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:42.582851 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:42.583682 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:42.584730 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:42.585599 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:42.586080 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:42.586239 (+ 159us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:42.589142 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:42.589150 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:42.589169 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:42.589208 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:42.591068 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:42.591708 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:42.591714 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:42.591722 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:42.591858 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:42.592223 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:42.592226 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:42.592228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:42.592690 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:42.593619 (+ 929us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:42.593798 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 11:10:42.594036 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":142,"threads_started":1}
I20260812 11:10:42.597582 26368 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:42.598388 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:42.603667 26368 catalog_manager.cc:1347] Generated new cluster ID: 90a9ad57fa0146ea9fa3294028000a74
I20260812 11:10:42.603735 26368 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:42.609150 26337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:42.600496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35797 (local address 127.18.174.254:43167)
0812 11:10:42.600612 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:42.600616 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:42.600843 (+ 227us) server_negotiation.cc:407] Connection header received
0812 11:10:42.600966 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:42.600968 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:42.601016 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:42.601099 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:42.601885 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:42.602813 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:42.603745 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:42.604062 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:42.604606 (+ 544us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:42.605802 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:42.605806 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:42.605809 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:42.605835 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:42.607400 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:42.607897 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:42.607901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:42.607903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:42.608000 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:42.608314 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:42.608317 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:42.608319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:42.608526 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:42.608680 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:42.608888 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 11:10:42.608996 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:10:42.614626 26368 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:42.615571 26368 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:42.635816 26368 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87263f1d98f24c7d914b481d2ce7e3bc: Generated new TSK 0
I20260812 11:10:42.636669 26368 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:42.647895 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 26229
W20260812 11:10:42.668486 26205 connection.cc:535] client connection to 127.18.174.254:43167 recv error: Network error: failed to read from TLS socket (remote: 127.18.174.254:43167): Connection reset by peer (error 104)
2026-08-12T11:10:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1578 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:42 dist-test-slave-lgr5 krb5kdc[26399](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:42 dist-test-slave-lgr5 krb5kdc[26399](info): set up 2 sockets
Aug 12 11:10:42 dist-test-slave-lgr5 krb5kdc[26399](info): commencing operation
krb5kdc: starting...
W20260812 11:10:43.855156 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:43 dist-test-slave-lgr5 krb5kdc[26399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:10:43.980584 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:44981
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:34223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:44981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:44.095247 26424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:44.095536 26424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:44.095597 26424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:44.099781 26424 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:44.099855 26424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:44.099887 26424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:44.099911 26424 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:44.099944 26424 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:44.105278 26424 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:34223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:44981
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:44981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:44.106345 26424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:44.107419 26424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:10:44.115939 26424 server_base.cc:1034] running on GCE node
W20260812 11:10:44.115906 26431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:44.115880 26432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:44.115885 26434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:44.116724 26424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:44.117815 26424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:44.118983 26424 hybrid_clock.cc:648] HybridClock initialized: now 1786533044118965 us; error 30 us; skew 500 ppm
Aug 12 11:10:44 dist-test-slave-lgr5 krb5kdc[26399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533044, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:44.125829 26424 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:10:44.126777 26424 webserver.cc:460] Webserver started at http://127.18.174.254:40941/ using document root <none> and password file <none>
I20260812 11:10:44.127308 26424 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:44.127364 26424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:44.127538 26424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:44.129630 26424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "daad69f4f21046acaa4e8df7675fc35e"
format_stamp: "Formatted at 2026-08-12 11:10:44 on dist-test-slave-lgr5"
server_key: "270a14cc1ef2d3a8efcd2dc5b0042a7f"
server_key_iv: "4b092a4447f3656c40763646160698ca"
server_key_version: "encryptionkey@0"
I20260812 11:10:44.130151 26424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "daad69f4f21046acaa4e8df7675fc35e"
format_stamp: "Formatted at 2026-08-12 11:10:44 on dist-test-slave-lgr5"
server_key: "270a14cc1ef2d3a8efcd2dc5b0042a7f"
server_key_iv: "4b092a4447f3656c40763646160698ca"
server_key_version: "encryptionkey@0"
I20260812 11:10:44.133817 26424 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:10:44.136214 26446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:44.137434 26424 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:44.137537 26424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "daad69f4f21046acaa4e8df7675fc35e"
format_stamp: "Formatted at 2026-08-12 11:10:44 on dist-test-slave-lgr5"
server_key: "270a14cc1ef2d3a8efcd2dc5b0042a7f"
server_key_iv: "4b092a4447f3656c40763646160698ca"
server_key_version: "encryptionkey@0"
I20260812 11:10:44.137621 26424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:44.160133 26424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:44.163371 26424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:44.163542 26424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:44.170696 26424 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:44981
I20260812 11:10:44.170725 26535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:44981 every 8 connection(s)
I20260812 11:10:44.171727 26424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:44.174790 26537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:44.178067 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 26424
I20260812 11:10:44.178200 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:44.178460 19131 external_mini_cluster.cc:1428] Setting key 0d203ee634d8f982c5e707ef9a2e0055
I20260812 11:10:44.181038 26537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e: Bootstrap starting.
I20260812 11:10:44.183357 26537 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:44.184131 26537 log.cc:824] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:44.186311 26537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e: No bootstrap required, opened a new log
I20260812 11:10:44.187484 26544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:44.179922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52423 (local address 127.18.174.254:44981)
0812 11:10:44.180425 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:44.180440 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:44.180485 (+ 45us) server_negotiation.cc:407] Connection header received
0812 11:10:44.181117 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:44.181134 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:44.181529 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:44.181835 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:44.182253 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:44.183235 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:44.184173 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:44.184811 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:44.184954 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:44.185854 (+ 900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:44.185859 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:44.185872 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:44.186255 (+ 383us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:44.186311 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:44.186332 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:44.186452 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:44.186651 (+ 199us) server_negotiation.cc:299] Negotiation successful
0812 11:10:44.186786 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":175,"threads_started":1}
I20260812 11:10:44.189792 26537 raft_consensus.cc:348] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daad69f4f21046acaa4e8df7675fc35e" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44981 } }
I20260812 11:10:44.190061 26537 raft_consensus.cc:374] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:44.190125 26537 raft_consensus.cc:729] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daad69f4f21046acaa4e8df7675fc35e, State: Initialized, Role: FOLLOWER
I20260812 11:10:44.190631 26537 consensus_queue.cc:260] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daad69f4f21046acaa4e8df7675fc35e" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44981 } }
I20260812 11:10:44.190801 26537 raft_consensus.cc:388] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:44.190874 26537 raft_consensus.cc:482] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:44.190930 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:44.190974 26537 raft_consensus.cc:3037] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:44.191844 26537 raft_consensus.cc:504] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daad69f4f21046acaa4e8df7675fc35e" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44981 } }
I20260812 11:10:44.192219 26537 leader_election.cc:302] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: daad69f4f21046acaa4e8df7675fc35e; no voters:
I20260812 11:10:44.192534 26537 leader_election.cc:288] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:44.192613 26554 raft_consensus.cc:2781] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:44.192804 26554 raft_consensus.cc:686] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [term 1 LEADER]: Becoming Leader. State: Replica: daad69f4f21046acaa4e8df7675fc35e, State: Running, Role: LEADER
I20260812 11:10:44.193178 26554 consensus_queue.cc:237] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daad69f4f21046acaa4e8df7675fc35e" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44981 } }
I20260812 11:10:44.193878 26537 sys_catalog.cc:564] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:44.194406 26554 sys_catalog.cc:455] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [sys.catalog]: SysCatalogTable state changed. Reason: New leader daad69f4f21046acaa4e8df7675fc35e. Latest consensus state: current_term: 1 leader_uuid: "daad69f4f21046acaa4e8df7675fc35e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daad69f4f21046acaa4e8df7675fc35e" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44981 } } }
I20260812 11:10:44.194528 26554 sys_catalog.cc:458] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:44.194782 26554 sys_catalog.cc:455] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "daad69f4f21046acaa4e8df7675fc35e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daad69f4f21046acaa4e8df7675fc35e" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 44981 } } }
I20260812 11:10:44.194926 26561 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:44.194926 26554 sys_catalog.cc:458] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:44.198261 26561 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:44.200122 26544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:44.192883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56397 (local address 127.18.174.254:44981)
0812 11:10:44.192985 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:44.192989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:44.195408 (+ 2419us) server_negotiation.cc:407] Connection header received
0812 11:10:44.195630 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:44.195634 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:44.195688 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:44.195743 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:44.196243 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:44.197027 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:44.198216 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:44.198529 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:44.198623 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:44.199508 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:44.199511 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:44.199514 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:44.199527 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:44.199556 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:44.199566 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:44.199639 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:44.199944 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 11:10:44.199982 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:10:44.204037 26561 catalog_manager.cc:1347] Generated new cluster ID: d9597d9bee5049b888ad31467f3653ae
I20260812 11:10:44.204111 26561 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:44.227174 26561 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:44.228171 26561 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:44.236943 26561 catalog_manager.cc:5868] T 00000000000000000000000000000000 P daad69f4f21046acaa4e8df7675fc35e: Generated new TSK 0
I20260812 11:10:44.237664 26561 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:44.241679 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 26424
W20260812 11:10:44.262781 26394 connection.cc:535] client connection to 127.18.174.254:44981 recv error: Network error: failed to read from TLS socket (remote: 127.18.174.254:44981): Connection reset by peer (error 104)
2026-08-12T11:10:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1594 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:44 dist-test-slave-lgr5 krb5kdc[26589](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:44 dist-test-slave-lgr5 krb5kdc[26589](info): set up 2 sockets
Aug 12 11:10:44 dist-test-slave-lgr5 krb5kdc[26589](info): commencing operation
krb5kdc: starting...
W20260812 11:10:45.444826 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:45 dist-test-slave-lgr5 krb5kdc[26589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:10:45.570345 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:42861
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:44471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:42861
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:45.684993 26608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:45.685282 26608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:45.685326 26608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:45.689324 26608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:45.689386 26608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:45.689404 26608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:45.689420 26608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:45.689433 26608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:45.694725 26608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:44471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:42861
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:42861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:45.695802 26608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:45.696843 26608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:45.705467 26616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:45.705516 26619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:45.705518 26617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:45.705736 26608 server_base.cc:1034] running on GCE node
I20260812 11:10:45.706283 26608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:45.707444 26608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:45.708606 26608 hybrid_clock.cc:648] HybridClock initialized: now 1786533045708578 us; error 37 us; skew 500 ppm
Aug 12 11:10:45 dist-test-slave-lgr5 krb5kdc[26589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533045, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:45.711369 26608 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:10:45.712276 26608 webserver.cc:460] Webserver started at http://127.18.174.254:38813/ using document root <none> and password file <none>
I20260812 11:10:45.712818 26608 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:45.712880 26608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:45.713049 26608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:45.715123 26608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "935a2702fc8a456eae07032311e1e09f"
format_stamp: "Formatted at 2026-08-12 11:10:45 on dist-test-slave-lgr5"
server_key: "2fbf0ae665a9a6fcdb0582158f0d1bfd"
server_key_iv: "1f9e6c721cf3b84df2d93fe1d21ac0dd"
server_key_version: "encryptionkey@0"
I20260812 11:10:45.715653 26608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "935a2702fc8a456eae07032311e1e09f"
format_stamp: "Formatted at 2026-08-12 11:10:45 on dist-test-slave-lgr5"
server_key: "2fbf0ae665a9a6fcdb0582158f0d1bfd"
server_key_iv: "1f9e6c721cf3b84df2d93fe1d21ac0dd"
server_key_version: "encryptionkey@0"
I20260812 11:10:45.719621 26608 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:10:45.722368 26627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:45.723718 26608 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:10:45.723882 26608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "935a2702fc8a456eae07032311e1e09f"
format_stamp: "Formatted at 2026-08-12 11:10:45 on dist-test-slave-lgr5"
server_key: "2fbf0ae665a9a6fcdb0582158f0d1bfd"
server_key_iv: "1f9e6c721cf3b84df2d93fe1d21ac0dd"
server_key_version: "encryptionkey@0"
I20260812 11:10:45.723999 26608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:45.728838 26608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:45.731977 26608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:45.732178 26608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:45.739174 26608 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:42861
I20260812 11:10:45.739220 26732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:42861 every 8 connection(s)
I20260812 11:10:45.740196 26608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:45.743109 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:45.747303 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 26608
I20260812 11:10:45.747416 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:45.747690 19131 external_mini_cluster.cc:1428] Setting key 059520cc4f838cd6f12fa83fa52731d7
I20260812 11:10:45.749037 26734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f: Bootstrap starting.
I20260812 11:10:45.751391 26734 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:45.752276 26734 log.cc:824] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:45.752938 26738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:45.749039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57655 (local address 127.18.174.254:42861)
0812 11:10:45.749453 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:45.749470 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:45.749506 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:10:45.750159 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:45.750177 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:45.750478 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:45.750754 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:45.751636 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:45.751640 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:45.751652 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:45.751663 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:45.751718 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:45.751738 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:45.751821 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:45.751935 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 11:10:45.752114 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":139,"threads_started":1}
I20260812 11:10:45.754369 26734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f: No bootstrap required, opened a new log
I20260812 11:10:45.755719 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:45.758360 26734 raft_consensus.cc:348] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "935a2702fc8a456eae07032311e1e09f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 42861 } }
I20260812 11:10:45.758630 26734 raft_consensus.cc:374] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:45.758688 26734 raft_consensus.cc:729] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 935a2702fc8a456eae07032311e1e09f, State: Initialized, Role: FOLLOWER
I20260812 11:10:45.759138 26734 consensus_queue.cc:260] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "935a2702fc8a456eae07032311e1e09f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 42861 } }
I20260812 11:10:45.759413 26738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:45.757743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53319 (local address 127.18.174.254:42861)
0812 11:10:45.757868 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:45.757872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:45.758010 (+ 138us) server_negotiation.cc:407] Connection header received
0812 11:10:45.758105 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:45.758108 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:45.758144 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:45.758224 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:45.759011 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:45.759015 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:45.759017 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:45.759028 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:45.759053 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:45.759064 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:45.759137 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:45.759222 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 11:10:45.759261 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:10:45.759275 26734 raft_consensus.cc:388] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:45.759542 26734 raft_consensus.cc:482] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:45.759649 26734 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:45.760746 26734 raft_consensus.cc:504] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "935a2702fc8a456eae07032311e1e09f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 42861 } }
I20260812 11:10:45.761072 26734 leader_election.cc:302] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 935a2702fc8a456eae07032311e1e09f; no voters:
I20260812 11:10:45.761329 26734 leader_election.cc:288] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:45.761483 26747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:45.761688 26747 raft_consensus.cc:686] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [term 1 LEADER]: Becoming Leader. State: Replica: 935a2702fc8a456eae07032311e1e09f, State: Running, Role: LEADER
I20260812 11:10:45.762009 26747 consensus_queue.cc:237] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "935a2702fc8a456eae07032311e1e09f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 42861 } }
I20260812 11:10:45.762529 26734 sys_catalog.cc:564] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:45.763754 26749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 935a2702fc8a456eae07032311e1e09f. Latest consensus state: current_term: 1 leader_uuid: "935a2702fc8a456eae07032311e1e09f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "935a2702fc8a456eae07032311e1e09f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 42861 } } }
I20260812 11:10:45.763808 26748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "935a2702fc8a456eae07032311e1e09f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "935a2702fc8a456eae07032311e1e09f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 42861 } } }
I20260812 11:10:45.763876 26749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:45.763904 26748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:45.764247 26766 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:45.767452 26766 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:45.773310 26766 catalog_manager.cc:1347] Generated new cluster ID: 53d512d7a0f44d3a8d3660195148c441
I20260812 11:10:45.773393 26766 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:45.795751 26766 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:45.796211 26766 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:45.803217 26766 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 935a2702fc8a456eae07032311e1e09f: Generated new TSK 0
I20260812 11:10:45.804247 26766 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:45.809182 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 26608
2026-08-12T11:10:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1581 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:45 dist-test-slave-lgr5 krb5kdc[26787](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:45 dist-test-slave-lgr5 krb5kdc[26787](info): set up 2 sockets
Aug 12 11:10:45 dist-test-slave-lgr5 krb5kdc[26787](info): commencing operation
krb5kdc: starting...
W20260812 11:10:47.021875 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:47 dist-test-slave-lgr5 krb5kdc[26787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:10:47.148908 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45023
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:37869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:45023
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:47.259439 26804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:47.259708 26804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:47.259748 26804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:47.263758 26804 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:47.263823 26804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:47.263840 26804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:47.263855 26804 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:47.263870 26804 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:47.269066 26804 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:37869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:45023
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:45023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26804
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:47.270079 26804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:47.271086 26804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:47.279579 26815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:47.279546 26816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:47.279580 26820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:47.279937 26804 server_base.cc:1034] running on GCE node
I20260812 11:10:47.280539 26804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:47.281675 26804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:47.282866 26804 hybrid_clock.cc:648] HybridClock initialized: now 1786533047282828 us; error 35 us; skew 500 ppm
Aug 12 11:10:47 dist-test-slave-lgr5 krb5kdc[26787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533047, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:47.285722 26804 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:10:47.286619 26804 webserver.cc:460] Webserver started at http://127.18.174.254:44177/ using document root <none> and password file <none>
I20260812 11:10:47.287168 26804 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:47.287225 26804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:47.287403 26804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:47.289529 26804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "103a200db96d46d992caf198b8d64873"
format_stamp: "Formatted at 2026-08-12 11:10:47 on dist-test-slave-lgr5"
server_key: "cf580bdc82cceb3376778a4330f2871e"
server_key_iv: "93921040f0960738d4c31882e686d284"
server_key_version: "encryptionkey@0"
I20260812 11:10:47.290062 26804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "103a200db96d46d992caf198b8d64873"
format_stamp: "Formatted at 2026-08-12 11:10:47 on dist-test-slave-lgr5"
server_key: "cf580bdc82cceb3376778a4330f2871e"
server_key_iv: "93921040f0960738d4c31882e686d284"
server_key_version: "encryptionkey@0"
I20260812 11:10:47.293752 26804 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260812 11:10:47.296168 26831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:47.297438 26804 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:47.297551 26804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "103a200db96d46d992caf198b8d64873"
format_stamp: "Formatted at 2026-08-12 11:10:47 on dist-test-slave-lgr5"
server_key: "cf580bdc82cceb3376778a4330f2871e"
server_key_iv: "93921040f0960738d4c31882e686d284"
server_key_version: "encryptionkey@0"
I20260812 11:10:47.297645 26804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:47.313174 26804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:47.316408 26804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:47.316567 26804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:47.323410 26804 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:45023
I20260812 11:10:47.323432 26921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:45023 every 8 connection(s)
I20260812 11:10:47.324383 26804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:47.325284 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 26804
I20260812 11:10:47.325412 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:47.325680 19131 external_mini_cluster.cc:1428] Setting key e57221f6a8e6c1195c5da0691ad8ad34
I20260812 11:10:47.327454 26922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:47.334095 26922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873: Bootstrap starting.
Aug 12 11:10:47 dist-test-slave-lgr5 krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:47.336516 26922 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:47.337252 26922 log.cc:824] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:47.339618 26922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873: No bootstrap required, opened a new log
I20260812 11:10:47.340569 26925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:47.327040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59271 (local address 127.18.174.254:45023)
0812 11:10:47.327444 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:47.327463 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:47.327500 (+ 37us) server_negotiation.cc:407] Connection header received
0812 11:10:47.328242 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:47.328261 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:47.328616 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:47.328913 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:47.329857 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:47.330916 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:47.332114 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:47.332609 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:47.332737 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:47.335606 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:47.335612 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:47.335625 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:47.335656 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:47.337292 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:47.337819 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:47.337826 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:47.337833 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:47.337984 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:47.338343 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:47.338347 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:47.338348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:47.338791 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:47.338950 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:47.339384 (+ 434us) server_negotiation.cc:299] Negotiation successful
0812 11:10:47.339717 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":115,"threads_started":1}
I20260812 11:10:47.343688 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:47.343756 26922 raft_consensus.cc:348] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "103a200db96d46d992caf198b8d64873" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45023 } }
I20260812 11:10:47.344040 26922 raft_consensus.cc:374] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:47.344111 26922 raft_consensus.cc:729] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 103a200db96d46d992caf198b8d64873, State: Initialized, Role: FOLLOWER
I20260812 11:10:47.344601 26922 consensus_queue.cc:260] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "103a200db96d46d992caf198b8d64873" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45023 } }
I20260812 11:10:47.344769 26922 raft_consensus.cc:388] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:47.344851 26922 raft_consensus.cc:482] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:47.344997 26922 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:47.346194 26922 raft_consensus.cc:504] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "103a200db96d46d992caf198b8d64873" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45023 } }
I20260812 11:10:47.346537 26922 leader_election.cc:302] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 103a200db96d46d992caf198b8d64873; no voters:
I20260812 11:10:47.346833 26922 leader_election.cc:288] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:47.346925 26938 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:47.347121 26938 raft_consensus.cc:686] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [term 1 LEADER]: Becoming Leader. State: Replica: 103a200db96d46d992caf198b8d64873, State: Running, Role: LEADER
I20260812 11:10:47.347488 26938 consensus_queue.cc:237] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "103a200db96d46d992caf198b8d64873" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45023 } }
I20260812 11:10:47.348222 26922 sys_catalog.cc:564] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:47.348738 26938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 103a200db96d46d992caf198b8d64873. Latest consensus state: current_term: 1 leader_uuid: "103a200db96d46d992caf198b8d64873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "103a200db96d46d992caf198b8d64873" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45023 } } }
I20260812 11:10:47.349485 26938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:47.349356 26941 sys_catalog.cc:455] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "103a200db96d46d992caf198b8d64873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "103a200db96d46d992caf198b8d64873" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 45023 } } }
I20260812 11:10:47.349795 26941 sys_catalog.cc:458] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:47.350121 26957 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:47.353369 26957 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:47.354339 26925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:47.346081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60043 (local address 127.18.174.254:45023)
0812 11:10:47.346205 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:47.346210 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:47.346330 (+ 120us) server_negotiation.cc:407] Connection header received
0812 11:10:47.346438 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:47.346442 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:47.346489 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:47.346554 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:47.347350 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:47.348016 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:47.349223 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:47.349551 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:47.349628 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:47.351340 (+ 1712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:47.351344 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:47.351346 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:47.351374 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:47.352746 (+ 1372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:47.353134 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:47.353138 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:47.353140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:47.353220 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:47.353499 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:47.353502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:47.353504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:47.353687 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:47.353765 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:47.354072 (+ 307us) server_negotiation.cc:299] Negotiation successful
0812 11:10:47.354186 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 11:10:47.359074 26957 catalog_manager.cc:1347] Generated new cluster ID: a3af96d0aff74150a644539e32816abf
I20260812 11:10:47.359130 26957 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:47.363822 26957 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:47.364789 26957 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:47.372807 26957 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 103a200db96d46d992caf198b8d64873: Generated new TSK 0
I20260812 11:10:47.373706 26957 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:47.382265 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 26804
2026-08-12T11:10:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1557 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:47 dist-test-slave-lgr5 krb5kdc[26982](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:47 dist-test-slave-lgr5 krb5kdc[26982](info): set up 2 sockets
Aug 12 11:10:47 dist-test-slave-lgr5 krb5kdc[26982](info): commencing operation
krb5kdc: starting...
W20260812 11:10:48.611753 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:48 dist-test-slave-lgr5 krb5kdc[26982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533048, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:10:48.736827 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:40739
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:44331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:40739
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:48.849139 27005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:48.849433 27005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:48.849506 27005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:48.853504 27005 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:48.853566 27005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:48.853595 27005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:48.853616 27005 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:48.853645 27005 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:48.858996 27005 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:44331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:40739
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:40739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27005
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:48.860229 27005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:48.861333 27005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:48.870136 27019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:48.870141 27024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:48.870136 27018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:48.870419 27005 server_base.cc:1034] running on GCE node
I20260812 11:10:48.871094 27005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:48.872274 27005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:48.873440 27005 hybrid_clock.cc:648] HybridClock initialized: now 1786533048873416 us; error 34 us; skew 500 ppm
Aug 12 11:10:48 dist-test-slave-lgr5 krb5kdc[26982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533048, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:48.876420 27005 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:10:48.877426 27005 webserver.cc:460] Webserver started at http://127.18.174.254:44543/ using document root <none> and password file <none>
I20260812 11:10:48.878031 27005 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:48.878108 27005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:48.878341 27005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:48.880577 27005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "712dd6ca274746509aed6210cd58405f"
format_stamp: "Formatted at 2026-08-12 11:10:48 on dist-test-slave-lgr5"
server_key: "8fbced9641e5bba49c26e6697bcdd2ef"
server_key_iv: "89a840af5f9c6821706156da9ac81c60"
server_key_version: "encryptionkey@0"
I20260812 11:10:48.881186 27005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "712dd6ca274746509aed6210cd58405f"
format_stamp: "Formatted at 2026-08-12 11:10:48 on dist-test-slave-lgr5"
server_key: "8fbced9641e5bba49c26e6697bcdd2ef"
server_key_iv: "89a840af5f9c6821706156da9ac81c60"
server_key_version: "encryptionkey@0"
I20260812 11:10:48.885313 27005 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260812 11:10:48.887866 27035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:48.889132 27005 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:10:48.889256 27005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "712dd6ca274746509aed6210cd58405f"
format_stamp: "Formatted at 2026-08-12 11:10:48 on dist-test-slave-lgr5"
server_key: "8fbced9641e5bba49c26e6697bcdd2ef"
server_key_iv: "89a840af5f9c6821706156da9ac81c60"
server_key_version: "encryptionkey@0"
I20260812 11:10:48.889357 27005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:48.902122 27005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:48.905002 27005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:48.905175 27005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:48.912142 27005 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:40739
I20260812 11:10:48.912159 27132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:40739 every 8 connection(s)
I20260812 11:10:48.913125 27005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:48.913811 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 27005
I20260812 11:10:48.913949 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:48.914201 19131 external_mini_cluster.cc:1428] Setting key a596c7bc6bcf918eb60ccc4351e7f8c5
I20260812 11:10:48.916290 27134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:48.922466 27134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f: Bootstrap starting.
I20260812 11:10:48.923053 27141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:48.915554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45163 (local address 127.18.174.254:40739)
0812 11:10:48.915945 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:48.915962 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:48.915998 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:10:48.916708 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:48.916728 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:48.917078 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:48.917368 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:48.917734 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:48.918712 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:48.919885 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:48.920437 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:48.920567 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:48.921423 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:48.921428 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:48.921440 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:48.921814 (+ 374us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:48.921869 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:48.921891 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:48.921967 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:48.922121 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 11:10:48.922329 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":104,"threads_started":1}
I20260812 11:10:48.924804 27134 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:48.925595 27134 log.cc:824] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:48.926023 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:48.927865 27134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f: No bootstrap required, opened a new log
I20260812 11:10:48.931871 27141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:48.928122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48457 (local address 127.18.174.254:40739)
0812 11:10:48.928228 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:48.928232 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:48.928451 (+ 219us) server_negotiation.cc:407] Connection header received
0812 11:10:48.928535 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:48.928538 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:48.928580 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:48.928662 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:48.928867 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:48.929630 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:48.930373 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:48.930698 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:48.930799 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:48.931483 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:48.931487 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:48.931490 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:48.931502 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:48.931530 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:48.931542 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:48.931615 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:48.931670 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 11:10:48.931725 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 11:10:48.932228 27134 raft_consensus.cc:348] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "712dd6ca274746509aed6210cd58405f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40739 } }
I20260812 11:10:48.932530 27134 raft_consensus.cc:374] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:48.932585 27134 raft_consensus.cc:729] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712dd6ca274746509aed6210cd58405f, State: Initialized, Role: FOLLOWER
I20260812 11:10:48.933034 27134 consensus_queue.cc:260] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "712dd6ca274746509aed6210cd58405f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40739 } }
I20260812 11:10:48.933187 27134 raft_consensus.cc:388] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:48.933249 27134 raft_consensus.cc:482] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:48.933346 27134 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:48.934470 27134 raft_consensus.cc:504] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "712dd6ca274746509aed6210cd58405f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40739 } }
I20260812 11:10:48.934849 27134 leader_election.cc:302] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 712dd6ca274746509aed6210cd58405f; no voters:
I20260812 11:10:48.935187 27134 leader_election.cc:288] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:48.935312 27152 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:48.935547 27152 raft_consensus.cc:686] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [term 1 LEADER]: Becoming Leader. State: Replica: 712dd6ca274746509aed6210cd58405f, State: Running, Role: LEADER
I20260812 11:10:48.935876 27152 consensus_queue.cc:237] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "712dd6ca274746509aed6210cd58405f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40739 } }
I20260812 11:10:48.936510 27134 sys_catalog.cc:564] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:48.937700 27154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 712dd6ca274746509aed6210cd58405f. Latest consensus state: current_term: 1 leader_uuid: "712dd6ca274746509aed6210cd58405f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "712dd6ca274746509aed6210cd58405f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40739 } } }
I20260812 11:10:48.937842 27154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:48.937947 27153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "712dd6ca274746509aed6210cd58405f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "712dd6ca274746509aed6210cd58405f" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40739 } } }
I20260812 11:10:48.938113 27153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:48.938499 27167 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:48.941540 27167 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:48.947928 27167 catalog_manager.cc:1347] Generated new cluster ID: a3e10c6d077543518bcc3e4143b1854e
I20260812 11:10:48.948014 27167 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:48.952925 27167 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:48.954134 27167 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:48.961186 27167 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 712dd6ca274746509aed6210cd58405f: Generated new TSK 0
I20260812 11:10:48.962080 27167 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:48.966903 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 27005
2026-08-12T11:10:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1582 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:49 dist-test-slave-lgr5 krb5kdc[27186](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:49 dist-test-slave-lgr5 krb5kdc[27186](info): set up 2 sockets
Aug 12 11:10:49 dist-test-slave-lgr5 krb5kdc[27186](info): commencing operation
krb5kdc: starting...
W20260812 11:10:50.159071 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:50 dist-test-slave-lgr5 krb5kdc[27186](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:10:50.277228 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:40683
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:44935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:40683
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:50.388149 27208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:50.388437 27208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:50.388494 27208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:50.392411 27208 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:50.392467 27208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:50.392493 27208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:50.392513 27208 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:50.392534 27208 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:50.397717 27208 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:44935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:40683
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:40683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27208
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:50.398764 27208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:50.399770 27208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:50.407882 27230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:50.408062 27208 server_base.cc:1034] running on GCE node
W20260812 11:10:50.407889 27224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:50.407896 27223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:50.408771 27208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:50.409956 27208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:50.411131 27208 hybrid_clock.cc:648] HybridClock initialized: now 1786533050411098 us; error 43 us; skew 500 ppm
Aug 12 11:10:50 dist-test-slave-lgr5 krb5kdc[27186](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533050, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:50.419237 27208 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:10:50.420235 27208 webserver.cc:460] Webserver started at http://127.18.174.254:34223/ using document root <none> and password file <none>
I20260812 11:10:50.420789 27208 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:50.420848 27208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:50.421049 27208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:50.423121 27208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "27f15a7413234040b6e178167fa6ab98"
format_stamp: "Formatted at 2026-08-12 11:10:50 on dist-test-slave-lgr5"
server_key: "9329346480907c1061060cd98c90abc4"
server_key_iv: "11271f6ec8d6ee9bd4d6e9b5b4cfa93e"
server_key_version: "encryptionkey@0"
I20260812 11:10:50.423646 27208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "27f15a7413234040b6e178167fa6ab98"
format_stamp: "Formatted at 2026-08-12 11:10:50 on dist-test-slave-lgr5"
server_key: "9329346480907c1061060cd98c90abc4"
server_key_iv: "11271f6ec8d6ee9bd4d6e9b5b4cfa93e"
server_key_version: "encryptionkey@0"
I20260812 11:10:50.427289 27208 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260812 11:10:50.429760 27244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:50.430958 27208 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:10:50.431082 27208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "27f15a7413234040b6e178167fa6ab98"
format_stamp: "Formatted at 2026-08-12 11:10:50 on dist-test-slave-lgr5"
server_key: "9329346480907c1061060cd98c90abc4"
server_key_iv: "11271f6ec8d6ee9bd4d6e9b5b4cfa93e"
server_key_version: "encryptionkey@0"
I20260812 11:10:50.431175 27208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:50.435663 27208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:50.438705 27208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:50.438870 27208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:50.445684 27208 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:40683
I20260812 11:10:50.445719 27333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:40683 every 8 connection(s)
I20260812 11:10:50.446652 27208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:50.449406 27334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:50.453642 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 27208
I20260812 11:10:50.453759 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:50.454021 19131 external_mini_cluster.cc:1428] Setting key b9031e4eaaba563a4b2c26f3a6ba81ee
I20260812 11:10:50.455122 27334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98: Bootstrap starting.
I20260812 11:10:50.457484 27334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:50.458328 27334 log.cc:824] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:50.459041 27337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:50.455310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53467 (local address 127.18.174.254:40683)
0812 11:10:50.455692 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:50.455708 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:50.455744 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:10:50.456410 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:50.456430 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:50.456715 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:50.456989 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:50.457821 (+ 832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:50.457825 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:50.457837 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:50.457848 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:50.457905 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:50.457925 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:50.458014 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:50.458134 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 11:10:50.458280 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":96,"threads_started":1}
I20260812 11:10:50.460162 27334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98: No bootstrap required, opened a new log
I20260812 11:10:50.461663 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:50.464290 27334 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f15a7413234040b6e178167fa6ab98" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40683 } }
I20260812 11:10:50.464620 27334 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:50.464681 27334 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27f15a7413234040b6e178167fa6ab98, State: Initialized, Role: FOLLOWER
I20260812 11:10:50.465162 27334 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f15a7413234040b6e178167fa6ab98" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40683 } }
I20260812 11:10:50.465332 27334 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:50.465412 27334 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:50.465461 27337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:50.463863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55329 (local address 127.18.174.254:40683)
0812 11:10:50.464029 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:50.464032 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:50.464134 (+ 102us) server_negotiation.cc:407] Connection header received
0812 11:10:50.464248 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:50.464250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:50.464279 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:50.464338 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:50.465080 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:50.465082 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:50.465084 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:50.465095 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:50.465121 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:50.465131 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:50.465199 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:50.465295 (+ 96us) server_negotiation.cc:299] Negotiation successful
0812 11:10:50.465334 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260812 11:10:50.465518 27334 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:50.466391 27334 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f15a7413234040b6e178167fa6ab98" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40683 } }
I20260812 11:10:50.466707 27334 leader_election.cc:302] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27f15a7413234040b6e178167fa6ab98; no voters:
I20260812 11:10:50.466984 27334 leader_election.cc:288] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:50.467075 27350 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:50.467273 27350 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [term 1 LEADER]: Becoming Leader. State: Replica: 27f15a7413234040b6e178167fa6ab98, State: Running, Role: LEADER
I20260812 11:10:50.467572 27350 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f15a7413234040b6e178167fa6ab98" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40683 } }
I20260812 11:10:50.468155 27334 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:50.469157 27353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27f15a7413234040b6e178167fa6ab98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f15a7413234040b6e178167fa6ab98" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40683 } } }
I20260812 11:10:50.469286 27353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:50.469551 27355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27f15a7413234040b6e178167fa6ab98. Latest consensus state: current_term: 1 leader_uuid: "27f15a7413234040b6e178167fa6ab98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f15a7413234040b6e178167fa6ab98" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 40683 } } }
I20260812 11:10:50.469645 27355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:50.469753 27366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:50.472961 27366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:50.478708 27366 catalog_manager.cc:1347] Generated new cluster ID: d99ff58725ff4b0ba6470328477c57dd
I20260812 11:10:50.478773 27366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:50.498109 27366 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:50.498474 27366 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:50.505968 27366 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27f15a7413234040b6e178167fa6ab98: Generated new TSK 0
I20260812 11:10:50.506790 27366 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:50.510149 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 27208
2026-08-12T11:10:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1549 ms)
[----------] 18 tests from AuthTokenIssuingTest (28555 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:50 dist-test-slave-lgr5 krb5kdc[27388](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:50 dist-test-slave-lgr5 krb5kdc[27388](info): set up 2 sockets
Aug 12 11:10:50 dist-test-slave-lgr5 krb5kdc[27388](info): commencing operation
krb5kdc: starting...
W20260812 11:10:51.710566 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:51 dist-test-slave-lgr5 krb5kdc[27388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:10:51.826737 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:38167
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:32917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:38167,127.18.174.253:36003,127.18.174.252:39853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:51.936506 27411 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:10:51.936762 27411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:51.936784 27411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:51.936836 27411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:51.940755 27411 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:51.940809 27411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:51.940827 27411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:51.940851 27411 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:51.940879 27411 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:51.946079 27411 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:32917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:38167,127.18.174.253:36003,127.18.174.252:39853
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:38167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:51.947089 27411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:51.948109 27411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:51.956327 27423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:51.956271 27418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:51.956306 27411 server_base.cc:1034] running on GCE node
W20260812 11:10:51.956264 27417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:51.957204 27411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:51.958261 27411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:51.959414 27411 hybrid_clock.cc:648] HybridClock initialized: now 1786533051959395 us; error 31 us; skew 500 ppm
Aug 12 11:10:51 dist-test-slave-lgr5 krb5kdc[27388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533051, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:51.962036 27411 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:10:51.962872 27411 webserver.cc:460] Webserver started at http://127.18.174.254:37489/ using document root <none> and password file <none>
I20260812 11:10:51.963380 27411 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:51.963444 27411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:51.963640 27411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:51.965647 27411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "bd87cfecf5d44252b6fc6c13780b3294"
format_stamp: "Formatted at 2026-08-12 11:10:51 on dist-test-slave-lgr5"
server_key: "b621ce2968c658ae30186f70fa8a6910"
server_key_iv: "b08a3ab346293298eb449550d630b160"
server_key_version: "encryptionkey@0"
I20260812 11:10:51.966179 27411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "bd87cfecf5d44252b6fc6c13780b3294"
format_stamp: "Formatted at 2026-08-12 11:10:51 on dist-test-slave-lgr5"
server_key: "b621ce2968c658ae30186f70fa8a6910"
server_key_iv: "b08a3ab346293298eb449550d630b160"
server_key_version: "encryptionkey@0"
I20260812 11:10:51.969843 27411 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:10:51.972251 27442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:51.973428 27411 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:51.973542 27411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "bd87cfecf5d44252b6fc6c13780b3294"
format_stamp: "Formatted at 2026-08-12 11:10:51 on dist-test-slave-lgr5"
server_key: "b621ce2968c658ae30186f70fa8a6910"
server_key_iv: "b08a3ab346293298eb449550d630b160"
server_key_version: "encryptionkey@0"
I20260812 11:10:51.973641 27411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:51.991516 27411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:51.994244 27411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:51.994414 27411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:52.001197 27411 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:38167
I20260812 11:10:52.001469 27537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:38167 every 8 connection(s)
I20260812 11:10:52.002157 27411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:52.002480 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 27411
I20260812 11:10:52.002601 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:52.002928 19131 external_mini_cluster.cc:1428] Setting key 9c0be40342ec72841a32455ad0a0433a
I20260812 11:10:52.005584 27539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:52.009449 27539 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.18.174.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.253@KRBTEST.COM" created.
Aug 12 11:10:52 dist-test-slave-lgr5 krb5kdc[27388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533051, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:52.024794 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.011731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:38167 (local address 127.0.0.1:45590)
0812 11:10:52.012256 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.012299 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:52.013125 (+ 826us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:52.013978 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:52.013985 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:52.014423 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:52.014770 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.014788 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.015925 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.015928 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.017069 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.017080 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.017712 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.017718 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.017846 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.018417 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:52.018438 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:52.020130 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:52.021890 (+ 1760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.021900 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.021909 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.022117 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.022432 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.022434 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.022436 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.022552 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.023158 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:52.023164 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:52.023309 (+ 145us) client_negotiation.cc:769] Sending connection context
0812 11:10:52.023466 (+ 157us) client_negotiation.cc:240] Negotiation successful
0812 11:10:52.023837 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":85,"thread_start_us":131,"threads_started":1}
I20260812 11:10:52.024808 27544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.012534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45590 (local address 127.18.174.254:38167)
0812 11:10:52.012790 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.012798 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.012833 (+ 35us) server_negotiation.cc:407] Connection header received
0812 11:10:52.013476 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.013506 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.013755 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.013950 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.014913 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.015802 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.017174 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.017549 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.017663 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.020263 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.020269 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.020279 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.020300 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.021781 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.022205 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.022210 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.022211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.022336 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.022647 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.022650 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.022651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.023051 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.023165 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.023577 (+ 412us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.023752 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":73,"threads_started":1}
I20260812 11:10:52.027103 27539 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.253.keytab.
Entry for principal kudu/127.18.174.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.253.keytab.
I20260812 11:10:52.027774 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.027528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:36003 (local address 127.0.0.1:38402)
0812 11:10:52.027621 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.027702 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:36003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 11:10:52.027952 27443 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.174.253:36003: connect: Connection refused (error 111)
I20260812 11:10:52.028587 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.253:36003
--webserver_interface=127.18.174.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.253.keytab
--principal=kudu/127.18.174.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:32917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:38167,127.18.174.253:36003,127.18.174.252:39853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:10:52.028723 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.028524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:36003 (local address 127.0.0.1:38410)
0812 11:10:52.028621 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.028665 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:36003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260812 11:10:52.028858 27539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.253:36003: Network error: Client connection negotiation failed: client connection to 127.18.174.253:36003: connect: Connection refused (error 111)
I20260812 11:10:52.078117 27539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } attempt: 1
I20260812 11:10:52.078926 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.078624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:36003 (local address 127.0.0.1:38422)
0812 11:10:52.078766 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.078845 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:36003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 11:10:52.079624 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.079424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:36003 (local address 127.0.0.1:38426)
0812 11:10:52.079522 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.079566 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:36003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 11:10:52.079756 27539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.253:36003: Network error: Client connection negotiation failed: client connection to 127.18.174.253:36003: connect: Connection refused (error 111)
W20260812 11:10:52.138170 27552 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:10:52.138491 27552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:52.138517 27552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:52.138564 27552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:52.142726 27552 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:52.142791 27552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:52.142810 27552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:52.142825 27552 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:52.142845 27552 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:52.147900 27539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } attempt: 2
I20260812 11:10:52.148386 27552 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:32917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:38167,127.18.174.253:36003,127.18.174.252:39853
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.253.keytab
--principal=kudu/127.18.174.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.253:36003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.174.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:52.148792 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.148467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:36003 (local address 127.0.0.1:38432)
0812 11:10:52.148637 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.148708 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:36003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 11:10:52.149456 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.149269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:36003 (local address 127.0.0.1:38434)
0812 11:10:52.149352 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.149395 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:36003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 11:10:52.149567 27539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.253:36003: Network error: Client connection negotiation failed: client connection to 127.18.174.253:36003: connect: Connection refused (error 111)
I20260812 11:10:52.149729 27552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:52.150741 27552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:52.159060 27562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:52.159067 27566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:52.159114 27563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:52.159170 27552 server_base.cc:1034] running on GCE node
I20260812 11:10:52.159876 27552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:52.161049 27552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:52.162214 27552 hybrid_clock.cc:648] HybridClock initialized: now 1786533052162195 us; error 35 us; skew 500 ppm
Aug 12 11:10:52 dist-test-slave-lgr5 krb5kdc[27388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:52.165005 27552 init.cc:377] Logged in from keytab as kudu/127.18.174.253@KRBTEST.COM (short username kudu)
I20260812 11:10:52.165865 27552 webserver.cc:460] Webserver started at http://127.18.174.253:32857/ using document root <none> and password file <none>
I20260812 11:10:52.166384 27552 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:52.166440 27552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:52.166633 27552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:52.168711 27552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/data/instance:
uuid: "23e0bfc3d1f84e56a458bbb073b06eb9"
format_stamp: "Formatted at 2026-08-12 11:10:52 on dist-test-slave-lgr5"
server_key: "ab7bb9c5ffea0896eef7a4955eb91cdc"
server_key_iv: "2eca7f25e4d06cb0438ef0d6dc8e5853"
server_key_version: "encryptionkey@0"
I20260812 11:10:52.169224 27552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/wal/instance:
uuid: "23e0bfc3d1f84e56a458bbb073b06eb9"
format_stamp: "Formatted at 2026-08-12 11:10:52 on dist-test-slave-lgr5"
server_key: "ab7bb9c5ffea0896eef7a4955eb91cdc"
server_key_iv: "2eca7f25e4d06cb0438ef0d6dc8e5853"
server_key_version: "encryptionkey@0"
I20260812 11:10:52.172794 27552 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:10:52.175141 27584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:52.176321 27552 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260812 11:10:52.176421 27552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/wal
uuid: "23e0bfc3d1f84e56a458bbb073b06eb9"
format_stamp: "Formatted at 2026-08-12 11:10:52 on dist-test-slave-lgr5"
server_key: "ab7bb9c5ffea0896eef7a4955eb91cdc"
server_key_iv: "2eca7f25e4d06cb0438ef0d6dc8e5853"
server_key_version: "encryptionkey@0"
I20260812 11:10:52.176519 27552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:52.223907 27552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:52.227169 27552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:52.227335 27552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:52.234035 27552 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.253:36003
I20260812 11:10:52.234302 27676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.253:36003 every 8 connection(s)
I20260812 11:10:52.234974 27552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/data/info.pb
I20260812 11:10:52.237711 27677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:52.240708 27539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } attempt: 3
I20260812 11:10:52.241590 27677 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:10:52.245095 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 27552
I20260812 11:10:52.245224 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-1/wal/instance
I20260812 11:10:52.245527 19131 external_mini_cluster.cc:1428] Setting key 815193efd5c022bcc4dd8ebf749336f6
Aug 12 11:10:52 dist-test-slave-lgr5 krb5kdc[27388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.253@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
Aug 12 11:10:52 dist-test-slave-lgr5 krb5kdc[27388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533051, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for kudu/127.18.174.253@KRBTEST.COM
I20260812 11:10:52.252905 27544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.243242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45594 (local address 127.18.174.254:38167)
0812 11:10:52.243368 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.243373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.243637 (+ 264us) server_negotiation.cc:407] Connection header received
0812 11:10:52.243836 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.243839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.243884 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.243924 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.244720 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.245263 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.246436 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.246749 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.246839 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.249340 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.249344 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.249347 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.249373 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.250794 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.251257 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.251261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.251263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.251347 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.251757 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.251761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.251763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.251978 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.252097 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.252623 (+ 526us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.252741 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":45}
I20260812 11:10:52.253209 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.241204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:36003 (local address 127.0.0.1:38438)
0812 11:10:52.241375 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.241392 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:52.241506 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:52.243602 (+ 2096us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:52.243605 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:52.243803 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:52.243941 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.243948 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.245319 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.245322 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.246088 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.246100 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.246770 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.246774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.246870 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.247368 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:52.247379 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:52.249521 (+ 2142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:52.251535 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.251538 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.251540 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.251759 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.252008 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.252012 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.252014 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.252136 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.252731 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:52.252734 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:52.252831 (+ 97us) client_negotiation.cc:769] Sending connection context
0812 11:10:52.252932 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 11:10:52.253061 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 11:10:52.253757 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.243153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:38167 (local address 127.0.0.1:45594)
0812 11:10:52.243519 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.243565 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:52.243734 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:52.244119 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:52.244125 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:52.244434 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:52.244589 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.244599 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.245372 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.245375 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.246332 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.246341 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.247004 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.247009 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.247111 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.247557 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:52.247576 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:52.249152 (+ 1576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:52.250898 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.250908 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.250918 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.251163 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.251456 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.251458 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.251460 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.251646 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.252068 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:52.252074 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:52.252377 (+ 303us) client_negotiation.cc:769] Sending connection context
0812 11:10:52.252545 (+ 168us) client_negotiation.cc:240] Negotiation successful
0812 11:10:52.252839 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":137,"threads_started":1}
I20260812 11:10:52.253759 27679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.241829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38438 (local address 127.18.174.253:36003)
0812 11:10:52.242228 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.242244 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.242280 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:10:52.242928 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.242945 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.243313 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.243642 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.244117 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.245176 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.246216 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.246661 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.246799 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.249660 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.249666 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.249678 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.249701 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.251424 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.251841 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.251846 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.251848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.251922 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.252238 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.252242 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.252244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.252544 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.252678 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.253441 (+ 763us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.253591 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"spinlock_wait_cycles":4352,"thread_start_us":129,"threads_started":1}
I20260812 11:10:52.255115 27677 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.18.174.252@KRBTEST.COM; defaulting to no policy
I20260812 11:10:52.256065 27539 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:10:52.256696 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.256467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:39853 (local address 127.0.0.1:55950)
0812 11:10:52.256582 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.256637 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 11:10:52.257385 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.257166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:39853 (local address 127.0.0.1:55966)
0812 11:10:52.257295 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.257336 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260812 11:10:52.257504 27539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:39853: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.252@KRBTEST.COM" created.
Aug 12 11:10:52 dist-test-slave-lgr5 krb5kdc[27388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.253@KRBTEST.COM for kudu/127.18.174.253@KRBTEST.COM
I20260812 11:10:52.263113 27679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.255660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38440 (local address 127.18.174.253:36003)
0812 11:10:52.255754 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.255757 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.255965 (+ 208us) server_negotiation.cc:407] Connection header received
0812 11:10:52.256432 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.256435 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.256478 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.256550 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.256903 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.257543 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.258289 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.258617 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.258716 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.260533 (+ 1817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.260536 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.260539 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.260561 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.261768 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.262125 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.262128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.262130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.262195 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.262418 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.262421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.262423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.262577 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.262658 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.262873 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.262994 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":37}
I20260812 11:10:52.263113 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.255594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:36003 (local address 127.0.0.1:38440)
0812 11:10:52.255905 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.255918 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:52.256014 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:52.256579 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:52.256582 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:52.256710 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:52.256812 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.256818 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.257626 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.257629 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.258188 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.258196 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.258722 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.258725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.258836 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.259220 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:52.259233 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:52.260411 (+ 1178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:52.261862 (+ 1451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.261865 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.261867 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.262044 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.262269 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.262271 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.262273 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.262345 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.262658 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:52.262661 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:52.262739 (+ 78us) client_negotiation.cc:769] Sending connection context
0812 11:10:52.262821 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 11:10:52.262944 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":2}
I20260812 11:10:52.264122 27677 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:10:52.264705 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.264488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:39853 (local address 127.0.0.1:55982)
0812 11:10:52.264582 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.264654 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 11:10:52.265193 27586 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
I20260812 11:10:52.265964 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.265774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:39853 (local address 127.0.0.1:55996)
0812 11:10:52.265875 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.265917 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 11:10:52.266096 27677 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:39853: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.252.keytab.
Entry for principal kudu/127.18.174.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.252.keytab.
I20260812 11:10:52.272804 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.252:39853
--webserver_interface=127.18.174.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.252.keytab
--principal=kudu/127.18.174.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:32917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:38167,127.18.174.253:36003,127.18.174.252:39853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:10:52.288647 27539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } attempt: 1
I20260812 11:10:52.289515 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.289219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:39853 (local address 127.0.0.1:56004)
0812 11:10:52.289370 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.289432 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 11:10:52.290199 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.289961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:39853 (local address 127.0.0.1:56014)
0812 11:10:52.290072 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.290126 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 11:10:52.291172 27539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:39853: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
I20260812 11:10:52.315332 27677 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } attempt: 1
I20260812 11:10:52.316299 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.315985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:39853 (local address 127.0.0.1:56030)
0812 11:10:52.316156 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.316219 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 11:10:52.317083 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.316775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:39853 (local address 127.0.0.1:56042)
0812 11:10:52.316925 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.316998 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260812 11:10:52.317277 27677 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:39853: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
I20260812 11:10:52.366334 27539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } attempt: 2
I20260812 11:10:52.367123 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.366824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:39853 (local address 127.0.0.1:56056)
0812 11:10:52.366964 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.367035 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 11:10:52.367945 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.367725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:39853 (local address 127.0.0.1:56072)
0812 11:10:52.367840 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.367887 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 11:10:52.368100 27539 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:39853: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
I20260812 11:10:52.385440 27677 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } attempt: 2
I20260812 11:10:52.386225 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.385888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:39853 (local address 127.0.0.1:56086)
0812 11:10:52.386052 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.386128 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 11:10:52.386940 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.386712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:39853 (local address 127.0.0.1:56102)
0812 11:10:52.386817 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.386874 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 11:10:52.387063 27677 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:39853: Network error: Client connection negotiation failed: client connection to 127.18.174.252:39853: connect: Connection refused (error 111)
W20260812 11:10:52.387912 27687 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:10:52.388201 27687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:52.388237 27687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:52.388289 27687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:52.392179 27687 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:52.392228 27687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:52.392256 27687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:52.392279 27687 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:52.392302 27687 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:52.397467 27687 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:32917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:38167,127.18.174.253:36003,127.18.174.252:39853
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.252.keytab
--principal=kudu/127.18.174.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.252:39853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.174.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:52.398434 27687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:52.399410 27687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:52.407646 27697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:52.407740 27703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:52.407685 27698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:52.407861 27687 server_base.cc:1034] running on GCE node
I20260812 11:10:52.408432 27687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:52.409503 27687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:52.410665 27687 hybrid_clock.cc:648] HybridClock initialized: now 1786533052410642 us; error 36 us; skew 500 ppm
Aug 12 11:10:52 dist-test-slave-lgr5 krb5kdc[27388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:52.413261 27687 init.cc:377] Logged in from keytab as kudu/127.18.174.252@KRBTEST.COM (short username kudu)
I20260812 11:10:52.414145 27687 webserver.cc:460] Webserver started at http://127.18.174.252:34777/ using document root <none> and password file <none>
I20260812 11:10:52.414670 27687 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:52.414732 27687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:52.414928 27687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:52.416976 27687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/data/instance:
uuid: "86f45dda8ac84f8080d812a070ee65c6"
format_stamp: "Formatted at 2026-08-12 11:10:52 on dist-test-slave-lgr5"
server_key: "12c6cae4fc92647287b020a660559554"
server_key_iv: "e7f3bffe3d716dc9f8904fe384bf80b9"
server_key_version: "encryptionkey@0"
I20260812 11:10:52.417485 27687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/wal/instance:
uuid: "86f45dda8ac84f8080d812a070ee65c6"
format_stamp: "Formatted at 2026-08-12 11:10:52 on dist-test-slave-lgr5"
server_key: "12c6cae4fc92647287b020a660559554"
server_key_iv: "e7f3bffe3d716dc9f8904fe384bf80b9"
server_key_version: "encryptionkey@0"
I20260812 11:10:52.420991 27687 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:10:52.423211 27712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:52.424412 27687 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:52.424539 27687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/wal
uuid: "86f45dda8ac84f8080d812a070ee65c6"
format_stamp: "Formatted at 2026-08-12 11:10:52 on dist-test-slave-lgr5"
server_key: "12c6cae4fc92647287b020a660559554"
server_key_iv: "e7f3bffe3d716dc9f8904fe384bf80b9"
server_key_version: "encryptionkey@0"
I20260812 11:10:52.424630 27687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:52.443780 27687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:52.446465 27687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:52.446630 27687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:52.453119 27687 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.252:39853
I20260812 11:10:52.453364 27814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.252:39853 every 8 connection(s)
I20260812 11:10:52.454031 27687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/data/info.pb
I20260812 11:10:52.456725 27815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:52.458844 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 27687
I20260812 11:10:52.458958 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532756485707-19131-0/minicluster-data/master-2/wal/instance
I20260812 11:10:52.459198 19131 external_mini_cluster.cc:1428] Setting key 38ece0ced6b84e58ad9a0a8c4a7fbf7e
I20260812 11:10:52.460630 27815 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:10:52.467253 27539 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } attempt: 3
Aug 12 11:10:52 dist-test-slave-lgr5 krb5kdc[27388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.252@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
Aug 12 11:10:52 dist-test-slave-lgr5 krb5kdc[27388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.252@KRBTEST.COM
Aug 12 11:10:52 dist-test-slave-lgr5 krb5kdc[27388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533051, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for kudu/127.18.174.252@KRBTEST.COM
I20260812 11:10:52.473120 27544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.462277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45610 (local address 127.18.174.254:38167)
0812 11:10:52.462402 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.462406 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.462819 (+ 413us) server_negotiation.cc:407] Connection header received
0812 11:10:52.462943 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.462946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.463006 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.463069 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.463776 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.464535 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.465801 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.466140 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.466228 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.469004 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.469007 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.469010 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.469036 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.470639 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.471182 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.471186 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.471187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.471273 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.471842 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.471846 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.471848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.472126 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.472228 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.472690 (+ 462us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.472969 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:10:52.473899 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.460507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56104 (local address 127.18.174.252:39853)
0812 11:10:52.460883 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.460900 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.460939 (+ 39us) server_negotiation.cc:407] Connection header received
0812 11:10:52.461587 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.461604 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.461947 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.462286 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.463150 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.464412 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.465587 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.466051 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.466205 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.469340 (+ 3135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.469347 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.469361 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.469386 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.470977 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.471446 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.471460 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.471462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.471532 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.471815 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.471818 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.471819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.472226 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.472421 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.472639 (+ 218us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.472918 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":105,"threads_started":1}
I20260812 11:10:52.473899 27821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.462217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:38167 (local address 127.0.0.1:45610)
0812 11:10:52.462664 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.462718 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:52.462850 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:52.463149 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:52.463154 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:52.463465 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:52.463628 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.463638 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.464637 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.464640 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.465686 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.465696 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.466273 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.466277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.466373 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.466893 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:52.466913 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:52.468802 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:52.470741 (+ 1939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.470750 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.470758 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.471100 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.471354 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.471357 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.471359 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.471525 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.472292 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:52.472299 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:52.472436 (+ 137us) client_negotiation.cc:769] Sending connection context
0812 11:10:52.473251 (+ 815us) client_negotiation.cc:240] Negotiation successful
0812 11:10:52.473416 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":131,"threads_started":1}
I20260812 11:10:52.475250 27815 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:10:52.476687 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.467635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:39853 (local address 127.0.0.1:56112)
0812 11:10:52.467815 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.467828 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:52.467898 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:52.468216 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:52.468218 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:52.468382 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:52.468465 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.468471 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.469273 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.469277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.470015 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.470029 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.470632 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.470636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.470723 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.471153 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:52.471168 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:52.472521 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:52.474968 (+ 2447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.474971 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.474973 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.475218 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.475576 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.475580 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.475582 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.475734 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.476203 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:52.476206 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:52.476300 (+ 94us) client_negotiation.cc:769] Sending connection context
0812 11:10:52.476410 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 11:10:52.476537 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110}
I20260812 11:10:52.477175 27824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.467680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56112 (local address 127.18.174.252:39853)
0812 11:10:52.467985 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.467995 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.468009 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:10:52.468044 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.468047 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.468108 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.468195 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.468572 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.469154 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.470155 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.470504 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.470609 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.472655 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.472658 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.472661 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.472686 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.474877 (+ 2191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.475329 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.475333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.475334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.475459 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.475865 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.475868 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.475870 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.476072 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.476849 (+ 777us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.476923 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.477028 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":93,"threads_started":1}
I20260812 11:10:52.478209 27677 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } attempt: 3
Aug 12 11:10:52 dist-test-slave-lgr5 krb5kdc[27388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.252@KRBTEST.COM for kudu/127.18.174.253@KRBTEST.COM
I20260812 11:10:52.480319 27539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294: Bootstrap starting.
I20260812 11:10:52.483995 27679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.475990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38446 (local address 127.18.174.253:36003)
0812 11:10:52.476131 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.476135 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.476149 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:10:52.476191 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.476194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.476239 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.476317 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.476723 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.477389 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.478282 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.478593 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.478687 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.480598 (+ 1911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.480602 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.480604 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.480630 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.482165 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.482604 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.482607 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.482609 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.482694 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.483017 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.483020 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.483022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.483244 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.483318 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.483697 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.483817 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:10:52.484416 27539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:52.484493 27821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.475820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:36003 (local address 127.0.0.1:38446)
0812 11:10:52.475921 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.475935 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:52.476001 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:52.476351 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:52.476354 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:52.476503 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:52.476610 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.476616 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.477511 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.477514 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.478167 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.478177 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.478800 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.478803 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.478903 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.479296 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:52.479310 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:52.480469 (+ 1159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:52.482264 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.482267 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.482270 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.482498 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.482804 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.482807 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.482809 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.482910 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.483393 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:52.483397 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:52.483490 (+ 93us) client_negotiation.cc:769] Sending connection context
0812 11:10:52.484205 (+ 715us) client_negotiation.cc:240] Negotiation successful
0812 11:10:52.484341 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
Aug 12 11:10:52 dist-test-slave-lgr5 krb5kdc[27388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:52.485270 27815 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:10:52.485919 27539 log.cc:824] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:10:52 dist-test-slave-lgr5 krb5kdc[27388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.253@KRBTEST.COM for kudu/127.18.174.252@KRBTEST.COM
I20260812 11:10:52.488915 27539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294: No bootstrap required, opened a new log
I20260812 11:10:52.489355 27544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.476723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45614 (local address 127.18.174.254:38167)
0812 11:10:52.476934 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.476938 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.476948 (+ 10us) server_negotiation.cc:407] Connection header received
0812 11:10:52.476986 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.476988 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.477024 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.477090 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.480385 (+ 3295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.481040 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.482166 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.482475 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.482577 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.485341 (+ 2764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.485345 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.485347 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.485373 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.487149 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.487614 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.487617 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.487619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.487704 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.487981 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.487984 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.487986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.488213 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.488375 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.489097 (+ 722us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.489211 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145}
I20260812 11:10:52.490487 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.478586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:39853 (local address 127.0.0.1:56114)
0812 11:10:52.478700 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.478714 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:52.478782 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:52.481434 (+ 2652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:52.481437 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:52.482317 (+ 880us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:52.482414 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.482420 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.483374 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.483378 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.484366 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.484378 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.485295 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.485299 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.485378 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.485852 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:52.485865 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:52.487211 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:52.488985 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.488988 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.488990 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.489213 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.489524 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.489527 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.489529 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.489617 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.490040 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:52.490043 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:52.490134 (+ 91us) client_negotiation.cc:769] Sending connection context
0812 11:10:52.490209 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 11:10:52.490349 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
Aug 12 11:10:52 dist-test-slave-lgr5 krb5kdc[27388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.252@KRBTEST.COM for kudu/127.18.174.252@KRBTEST.COM
I20260812 11:10:52.490968 27824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.480292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56114 (local address 127.18.174.252:39853)
0812 11:10:52.481211 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.481215 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.481226 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:10:52.481256 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.481259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.481295 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.481610 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.482553 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.483244 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.484867 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.485171 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.485619 (+ 448us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.487363 (+ 1744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.487367 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.487369 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.487392 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.488862 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.489351 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.489354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.489356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.489435 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.489721 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.489724 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.489726 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.489913 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.490645 (+ 732us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.490717 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.490824 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":850}
I20260812 11:10:52.493554 27539 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } }
I20260812 11:10:52.493785 27539 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd87cfecf5d44252b6fc6c13780b3294, State: Initialized, Role: FOLLOWER
I20260812 11:10:52.494097 27821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.485736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:39853 (local address 127.0.0.1:56118)
0812 11:10:52.485844 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.485857 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:52.485928 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:52.486707 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:52.486710 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:52.486850 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:52.486939 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.486945 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.487921 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.487924 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.488635 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.488645 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.489208 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.489212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.489282 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.489679 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:52.489693 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:52.491013 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:52.492827 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.492829 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.492831 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.493059 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.493294 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.493297 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.493298 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.493360 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.493681 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:52.493684 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:52.493755 (+ 71us) client_negotiation.cc:769] Sending connection context
0812 11:10:52.493828 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 11:10:52.493940 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"spinlock_wait_cycles":9600}
I20260812 11:10:52.494128 27539 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } }
I20260812 11:10:52.494226 27677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9: Bootstrap starting.
I20260812 11:10:52.494637 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.485769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56118 (local address 127.18.174.252:39853)
0812 11:10:52.486505 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.486509 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.486523 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:10:52.486556 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.486559 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.486599 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.487074 (+ 475us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.487150 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.487825 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.488744 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.489103 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.489655 (+ 552us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.491138 (+ 1483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.491141 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.491143 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.491163 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.492727 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.493155 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.493158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.493160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.493222 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.493430 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.493433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.493435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.493599 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.494345 (+ 746us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.494412 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.494511 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654}
W20260812 11:10:52.495875 27450 tablet.cc:2369] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:52.496979 27677 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9: Neither blocks nor log segments found. Creating new log.
Aug 12 11:10:52 dist-test-slave-lgr5 krb5kdc[27388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.253@KRBTEST.COM
I20260812 11:10:52.497450 27815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6: Bootstrap starting.
I20260812 11:10:52.497833 27677 log.cc:824] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:52.498420 27828 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } } }
I20260812 11:10:52.498572 27828 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:52.499868 27815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:52.500029 27677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9: No bootstrap required, opened a new log
I20260812 11:10:52.500691 27815 log.cc:824] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:52.500864 27679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.490973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38448 (local address 127.18.174.253:36003)
0812 11:10:52.491071 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.491075 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.491571 (+ 496us) server_negotiation.cc:407] Connection header received
0812 11:10:52.491874 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.491877 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.491920 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.491968 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.492824 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.493517 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.495312 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.495552 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.495635 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.497925 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.497928 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.497931 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.497955 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.499299 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.499666 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.499669 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.499671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.499742 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.499997 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.500000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.500002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.500219 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.500324 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.500625 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.500728 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:10:52.501434 27539 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:52.503952 27677 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } }
I20260812 11:10:52.504254 27677 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e0bfc3d1f84e56a458bbb073b06eb9, State: Initialized, Role: FOLLOWER
I20260812 11:10:52.504591 27677 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } }
I20260812 11:10:52.505057 27851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } } }
I20260812 11:10:52.505252 27851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:52.505967 27677 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:52.507285 27815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6: No bootstrap required, opened a new log
I20260812 11:10:52.507503 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:52.508965 27497 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "bd87cfecf5d44252b6fc6c13780b3294"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45614
I20260812 11:10:52.509243 27497 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 11:10:52.509348 27497 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [term 0 FOLLOWER]: Advancing to term 1
W20260812 11:10:52.509397 27848 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:10:52.509450 27848 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:10:52.510349 27497 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } }
I20260812 11:10:52.511078 27497 leader_election.cc:288] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [CANDIDATE]: Term 1 election: Requested vote from peers 23e0bfc3d1f84e56a458bbb073b06eb9 (127.18.174.253:36003), 86f45dda8ac84f8080d812a070ee65c6 (127.18.174.252:39853)
I20260812 11:10:52.508116 27411 master_runner.cc:186] Error getting master registration for 127.18.174.253:36003: OK, instance_id { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" instance_seqno: 1786533052232165 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:10:52.511814 27411 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:10:52.515959 27815 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } }
I20260812 11:10:52.516251 27815 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f45dda8ac84f8080d812a070ee65c6, State: Initialized, Role: FOLLOWER
I20260812 11:10:52.516580 27815 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } }
I20260812 11:10:52.517861 27815 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:52.517902 27760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bd87cfecf5d44252b6fc6c13780b3294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "86f45dda8ac84f8080d812a070ee65c6"
I20260812 11:10:52.518114 27760 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:52.519376 27760 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd87cfecf5d44252b6fc6c13780b3294 in term 1.
W20260812 11:10:52.510663 27875 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 11:10:52.511829 27624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bd87cfecf5d44252b6fc6c13780b3294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9"
I20260812 11:10:52.520268 27624 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:52.520326 27446 leader_election.cc:302] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86f45dda8ac84f8080d812a070ee65c6, bd87cfecf5d44252b6fc6c13780b3294; no voters:
I20260812 11:10:52.520589 27828 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:52.520800 27828 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [term 1 LEADER]: Becoming Leader. State: Replica: bd87cfecf5d44252b6fc6c13780b3294, State: Running, Role: LEADER
I20260812 11:10:52.517266 27552 master_runner.cc:186] Error getting master registration for 127.18.174.252:39853: OK, instance_id { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" instance_seqno: 1786533052451340 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:10:52.520926 27552 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:10:52.521129 27828 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } }
I20260812 11:10:52.521505 27624 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd87cfecf5d44252b6fc6c13780b3294 in term 1.
W20260812 11:10:52.522019 27875 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:10:52.522825 27828 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd87cfecf5d44252b6fc6c13780b3294. Latest consensus state: current_term: 1 leader_uuid: "bd87cfecf5d44252b6fc6c13780b3294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } } }
I20260812 11:10:52.522938 27828 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:52.524799 27908 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:52.525777 27908 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:52.528501 27679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.513468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38452 (local address 127.18.174.253:36003)
0812 11:10:52.513574 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.513578 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.514952 (+ 1374us) server_negotiation.cc:407] Connection header received
0812 11:10:52.515158 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.515161 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.515204 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.515250 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.516445 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.517190 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.522059 (+ 4869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.522378 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.522451 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.524508 (+ 2057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.524512 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.524515 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.524542 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.526341 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.526838 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.526843 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.526845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.526929 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.527245 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.527248 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.527250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.527458 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.527582 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.528250 (+ 668us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.528358 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 11:10:52.531361 27760 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6 [term 1 FOLLOWER]: Refusing update from remote peer bd87cfecf5d44252b6fc6c13780b3294: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:52.531399 27624 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9 [term 1 FOLLOWER]: Refusing update from remote peer bd87cfecf5d44252b6fc6c13780b3294: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:52.531946 27828 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:52.532370 27828 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:52.532693 27884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } } }
I20260812 11:10:52.532817 27884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:52.536273 27851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd87cfecf5d44252b6fc6c13780b3294. Latest consensus state: current_term: 1 leader_uuid: "bd87cfecf5d44252b6fc6c13780b3294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } } }
I20260812 11:10:52.536377 27851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:52.537086 27884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd87cfecf5d44252b6fc6c13780b3294. Latest consensus state: current_term: 1 leader_uuid: "bd87cfecf5d44252b6fc6c13780b3294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } } }
I20260812 11:10:52.537202 27884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:52.538220 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.528942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56120 (local address 127.18.174.252:39853)
0812 11:10:52.529128 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.529132 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.529284 (+ 152us) server_negotiation.cc:407] Connection header received
0812 11:10:52.529685 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.529689 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.529735 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.529814 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.530556 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.531236 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.532263 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.532591 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.532684 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.534787 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.534791 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.534794 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.534819 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.536384 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.536861 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.536865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.536867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.536958 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.537274 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.537277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.537279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.537482 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.537596 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.537947 (+ 351us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.538074 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260812 11:10:52.538762 27851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bd87cfecf5d44252b6fc6c13780b3294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } } }
I20260812 11:10:52.538870 27851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:52.539111 27828 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bd87cfecf5d44252b6fc6c13780b3294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } } }
I20260812 11:10:52.539273 27828 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:52.539497 27909 mvcc.cc:205] Tried to move back new op lower bound from 7317639383163056128 to 7317639383129714688. Current Snapshot: MvccSnapshot[applied={T|T < 7317639383163056128}]
I20260812 11:10:52.541093 27916 mvcc.cc:205] Tried to move back new op lower bound from 7317639383163056128 to 7317639383129714688. Current Snapshot: MvccSnapshot[applied={T|T < 7317639383163056128}]
I20260812 11:10:52.543511 27828 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bd87cfecf5d44252b6fc6c13780b3294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } } }
I20260812 11:10:52.543625 27828 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:52.544598 27922 mvcc.cc:205] Tried to move back new op lower bound from 7317639383163056128 to 7317639383129714688. Current Snapshot: MvccSnapshot[applied={T|T < 7317639383163056128}]
I20260812 11:10:52.544732 27908 catalog_manager.cc:1347] Generated new cluster ID: a4c07109f2c54b8aa6e12834175a0149
I20260812 11:10:52.544724 27884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bd87cfecf5d44252b6fc6c13780b3294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd87cfecf5d44252b6fc6c13780b3294" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 38167 } } peers { permanent_uuid: "23e0bfc3d1f84e56a458bbb073b06eb9" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 36003 } } peers { permanent_uuid: "86f45dda8ac84f8080d812a070ee65c6" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 39853 } } }
I20260812 11:10:52.544792 27908 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:52.544811 27884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 11:10:52.545212 27904 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:10:52.545270 27904 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:10:52.550711 27544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.528652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45624 (local address 127.18.174.254:38167)
0812 11:10:52.528756 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.528760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.538750 (+ 9990us) server_negotiation.cc:407] Connection header received
0812 11:10:52.538926 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.538930 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.538989 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.539039 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.539811 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.540627 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.541704 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.542047 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.542122 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.543717 (+ 1595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.543721 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.543724 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.543749 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.548914 (+ 5165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.549529 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.549533 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.549535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.549616 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.549859 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.549862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.549864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.550057 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.550157 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.550464 (+ 307us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.550572 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:10:52.564157 27908 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:52.565346 27908 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:52.582022 27908 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd87cfecf5d44252b6fc6c13780b3294: Generated new TSK 0
I20260812 11:10:52.582902 27908 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:10:52.609431 27544 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:52.606871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45636 (local address 127.18.174.254:38167)
0812 11:10:52.607021 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.607026 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.608355 (+ 1329us) server_negotiation.cc:407] Connection header received
0812 11:10:52.608571 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.608575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.608626 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.608676 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.609290 (+ 614us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45636: BlockingRecv error: recv got EOF from 127.0.0.1:45636 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260812 11:10:52.610786 27818 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:52.607732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56122 (local address 127.18.174.252:39853)
0812 11:10:52.607851 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.607855 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.609912 (+ 2057us) server_negotiation.cc:407] Connection header received
0812 11:10:52.610074 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.610078 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.610125 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.610175 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.610663 (+ 488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56122: BlockingRecv error: recv got EOF from 127.0.0.1:56122 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260812 11:10:52.612528 27679 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:52.611462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38468 (local address 127.18.174.253:36003)
0812 11:10:52.611582 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.611587 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.611636 (+ 49us) server_negotiation.cc:407] Connection header received
0812 11:10:52.611794 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.611797 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.611843 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.611889 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.612391 (+ 502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38468: BlockingRecv error: recv got EOF from 127.0.0.1:38468 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260812 11:10:52.618249 27679 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:52.616536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38482 (local address 127.18.174.253:36003)
0812 11:10:52.616642 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.616646 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.617198 (+ 552us) server_negotiation.cc:407] Connection header received
0812 11:10:52.617428 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.617432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.617531 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.617586 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.618134 (+ 548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38482: BlockingRecv error: recv got EOF from 127.0.0.1:38482 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260812 11:10:52.623557 27679 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:52.622034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38490 (local address 127.18.174.253:36003)
0812 11:10:52.622136 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.622140 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.622639 (+ 499us) server_negotiation.cc:407] Connection header received
0812 11:10:52.622824 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.622828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.622879 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.622929 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.623427 (+ 498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38490: BlockingRecv error: recv got EOF from 127.0.0.1:38490 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260812 11:10:52.629413 27679 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:52.627767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38500 (local address 127.18.174.253:36003)
0812 11:10:52.627865 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.627869 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.628475 (+ 606us) server_negotiation.cc:407] Connection header received
0812 11:10:52.628661 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.628665 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.628712 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.628760 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.629303 (+ 543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38500: BlockingRecv error: recv got EOF from 127.0.0.1:38500 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260812 11:10:52.637275 27679 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:52.635651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38502 (local address 127.18.174.253:36003)
0812 11:10:52.635799 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.635803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.636348 (+ 545us) server_negotiation.cc:407] Connection header received
0812 11:10:52.636553 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.636557 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.636606 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.636655 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.637161 (+ 506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38502: BlockingRecv error: recv got EOF from 127.0.0.1:38502 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260812 11:10:52.649572 27679 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:52.647681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38516 (local address 127.18.174.253:36003)
0812 11:10:52.647791 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.647796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.648403 (+ 607us) server_negotiation.cc:407] Connection header received
0812 11:10:52.648626 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.648629 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.648682 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.648731 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.649274 (+ 543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38516: BlockingRecv error: recv got EOF from 127.0.0.1:38516 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260812 11:10:52.670116 27679 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:52.668251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38530 (local address 127.18.174.253:36003)
0812 11:10:52.668374 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.668379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.668999 (+ 620us) server_negotiation.cc:407] Connection header received
0812 11:10:52.669241 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.669244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.669302 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.669359 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.669989 (+ 630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38530: BlockingRecv error: recv got EOF from 127.0.0.1:38530 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260812 11:10:52.706528 27679 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:52.704910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38542 (local address 127.18.174.253:36003)
0812 11:10:52.705043 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.705048 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.705690 (+ 642us) server_negotiation.cc:407] Connection header received
0812 11:10:52.705817 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.705821 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.705873 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.705942 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.706404 (+ 462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38542: BlockingRecv error: recv got EOF from 127.0.0.1:38542 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 11:10:52.774173 27679 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:52.772951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38556 (local address 127.18.174.253:36003)
0812 11:10:52.773074 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.773079 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.773260 (+ 181us) server_negotiation.cc:407] Connection header received
0812 11:10:52.773414 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.773416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.773467 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.773558 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.774039 (+ 481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38556: BlockingRecv error: recv got EOF from 127.0.0.1:38556 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260812 11:10:52.905175 27679 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:52.904149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38562 (local address 127.18.174.253:36003)
0812 11:10:52.904267 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.904271 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.904404 (+ 133us) server_negotiation.cc:407] Connection header received
0812 11:10:52.904550 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.904553 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.904602 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.904685 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.905055 (+ 370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38562: BlockingRecv error: recv got EOF from 127.0.0.1:38562 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260812 11:10:53.164391 27679 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:53.163216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38570 (local address 127.18.174.253:36003)
0812 11:10:53.163339 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:53.163343 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:53.163518 (+ 175us) server_negotiation.cc:407] Connection header received
0812 11:10:53.163661 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:53.163664 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:53.163714 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:53.163779 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:53.164262 (+ 483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38570: BlockingRecv error: recv got EOF from 127.0.0.1:38570 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 11:10:53.523391 27875 catalog_manager.cc:1259] Loaded cluster ID: a4c07109f2c54b8aa6e12834175a0149
I20260812 11:10:53.523480 27875 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9: loading cluster ID for follower catalog manager: success
I20260812 11:10:53.525199 27875 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9: acquiring CA information for follower catalog manager: success
I20260812 11:10:53.526350 27875 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 23e0bfc3d1f84e56a458bbb073b06eb9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:10:53.546574 27904 catalog_manager.cc:1259] Loaded cluster ID: a4c07109f2c54b8aa6e12834175a0149
I20260812 11:10:53.546654 27904 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6: loading cluster ID for follower catalog manager: success
I20260812 11:10:53.548388 27904 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6: acquiring CA information for follower catalog manager: success
I20260812 11:10:53.549515 27904 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 86f45dda8ac84f8080d812a070ee65c6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:10:53.682410 28045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:53.678508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38578 (local address 127.18.174.253:36003)
0812 11:10:53.678752 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:53.678756 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:53.678774 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:10:53.678928 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:53.678930 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:53.679084 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:53.679185 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:53.679438 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.679988 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.680910 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.681148 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.681239 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:53.681557 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:53.682015 (+ 458us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:53.682131 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:53.682194 (+ 63us) server_negotiation.cc:299] Negotiation successful
0812 11:10:53.682255 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":77,"threads_started":1}
I20260812 11:10:53.689174 28053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:53.685570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56128 (local address 127.18.174.252:39853)
0812 11:10:53.685809 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:53.685814 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:53.685826 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:10:53.685914 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:53.685917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:53.686073 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:53.686183 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:53.686405 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.686965 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.687764 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.687993 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.688105 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:53.688390 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:53.688810 (+ 420us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:53.688915 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:53.688979 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 11:10:53.689032 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":74,"threads_started":1}
I20260812 11:10:53.695243 28045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:53.692020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38586 (local address 127.18.174.253:36003)
0812 11:10:53.692152 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:53.692157 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:53.692171 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:10:53.692296 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:53.692299 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:53.692349 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:53.692424 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:53.692686 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.693263 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.694071 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.694414 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.694508 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:53.694809 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:53.694896 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:53.694960 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:53.695065 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 11:10:53.695117 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 11:10:53.695631 28053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:53.691887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56134 (local address 127.18.174.252:39853)
0812 11:10:53.692241 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:53.692245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:53.692304 (+ 59us) server_negotiation.cc:407] Connection header received
0812 11:10:53.692413 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:53.692416 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:53.692470 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:53.692536 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:53.692770 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.693452 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.694608 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.694858 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.694956 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:53.695213 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:53.695289 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:53.695336 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:53.695489 (+ 153us) server_negotiation.cc:299] Negotiation successful
0812 11:10:53.695539 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 11:10:53.696534 28069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:53.691785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45650 (local address 127.18.174.254:38167)
0812 11:10:53.692209 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:53.692213 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:53.692569 (+ 356us) server_negotiation.cc:407] Connection header received
0812 11:10:53.692663 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:53.692666 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:53.692847 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:53.692960 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:53.693188 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.693925 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.695021 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.695327 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.695428 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:53.695822 (+ 394us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:53.696178 (+ 356us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:53.696261 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:53.696339 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 11:10:53.696392 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":64,"threads_started":1}
I20260812 11:10:53.699234 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 27411
I20260812 11:10:53.714702 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 27552
I20260812 11:10:53.728147 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 27687
2026-08-12T11:10:53Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3210 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:53 dist-test-slave-lgr5 krb5kdc[28080](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:53 dist-test-slave-lgr5 krb5kdc[28080](info): set up 2 sockets
Aug 12 11:10:53 dist-test-slave-lgr5 krb5kdc[28080](info): commencing operation
krb5kdc: starting...
W20260812 11:10:54.910975 19131 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/test-user.keytab.
Aug 12 11:10:54 dist-test-slave-lgr5 krb5kdc[28080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.174.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
Entry for principal kudu/127.18.174.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab.
I20260812 11:10:55.031109 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:35195
--webserver_interface=127.18.174.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:36673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:35195,127.18.174.253:38247,127.18.174.252:41685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:55.139693 28099 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:10:55.139979 28099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:55.140020 28099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:55.140101 28099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:55.144073 28099 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:55.144152 28099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:55.144170 28099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:55.144186 28099 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:55.144199 28099 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:55.149348 28099 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:35195,127.18.174.253:38247,127.18.174.252:41685
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.254.keytab
--principal=kudu/127.18.174.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.254:35195
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.174.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:55.150334 28099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:55.151314 28099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:55.159644 28108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:55.159633 28114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:55.159633 28106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:55.159679 28099 server_base.cc:1034] running on GCE node
I20260812 11:10:55.160518 28099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:55.161559 28099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:55.162714 28099 hybrid_clock.cc:648] HybridClock initialized: now 1786533055162687 us; error 45 us; skew 500 ppm
Aug 12 11:10:55 dist-test-slave-lgr5 krb5kdc[28080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533055, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:55.165284 28099 init.cc:377] Logged in from keytab as kudu/127.18.174.254@KRBTEST.COM (short username kudu)
I20260812 11:10:55.166100 28099 webserver.cc:460] Webserver started at http://127.18.174.254:37661/ using document root <none> and password file <none>
I20260812 11:10:55.166599 28099 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:55.166653 28099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:55.166815 28099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:55.168792 28099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/data/instance:
uuid: "5754c9cf103148e7b04fad7609c775b2"
format_stamp: "Formatted at 2026-08-12 11:10:55 on dist-test-slave-lgr5"
server_key: "ffa52d2403cb7ca6d8fb61aedd813e79"
server_key_iv: "d0e8937ebd55b26fe0b6e8136f995988"
server_key_version: "encryptionkey@0"
I20260812 11:10:55.169270 28099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/wal/instance:
uuid: "5754c9cf103148e7b04fad7609c775b2"
format_stamp: "Formatted at 2026-08-12 11:10:55 on dist-test-slave-lgr5"
server_key: "ffa52d2403cb7ca6d8fb61aedd813e79"
server_key_iv: "d0e8937ebd55b26fe0b6e8136f995988"
server_key_version: "encryptionkey@0"
I20260812 11:10:55.172683 28099 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:55.174883 28125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:55.176041 28099 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:10:55.176206 28099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/wal
uuid: "5754c9cf103148e7b04fad7609c775b2"
format_stamp: "Formatted at 2026-08-12 11:10:55 on dist-test-slave-lgr5"
server_key: "ffa52d2403cb7ca6d8fb61aedd813e79"
server_key_iv: "d0e8937ebd55b26fe0b6e8136f995988"
server_key_version: "encryptionkey@0"
I20260812 11:10:55.176297 28099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:55.188596 28099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:55.191133 28099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:55.191301 28099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:55.197758 28099 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.254:35195
I20260812 11:10:55.198130 28235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.254:35195 every 8 connection(s)
I20260812 11:10:55.198764 28099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:55.201540 28238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:55.205330 28238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:10:55.206411 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 28099
I20260812 11:10:55.206509 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-0/wal/instance
I20260812 11:10:55.206761 19131 external_mini_cluster.cc:1428] Setting key d58f070e29e1568cf2d14b84f7ab1453
Aug 12 11:10:55 dist-test-slave-lgr5 krb5kdc[28080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533055, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.174.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.253@KRBTEST.COM" created.
I20260812 11:10:55.221029 28242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.207661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41046 (local address 127.18.174.254:35195)
0812 11:10:55.208226 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.208243 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.208376 (+ 133us) server_negotiation.cc:407] Connection header received
0812 11:10:55.209457 (+ 1081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.209464 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.209728 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.209930 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.210856 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.211790 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.213223 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.213607 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.213723 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.216321 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.216329 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.216341 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.216364 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.217814 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.218328 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.218335 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.218336 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.218488 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.218792 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.218796 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.218798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.219188 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.219318 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.219718 (+ 400us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.219943 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"spinlock_wait_cycles":53504,"thread_start_us":149,"threads_started":1}
I20260812 11:10:55.221035 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.207661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:35195 (local address 127.0.0.1:41046)
0812 11:10:55.208219 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.208272 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:55.209148 (+ 876us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:55.209916 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:55.209922 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:55.210361 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:55.210710 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.210729 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.211920 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.211924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.213112 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.213125 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.213761 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.213765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.213874 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.214432 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:55.214452 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:55.216178 (+ 1726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:55.217907 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.217916 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.217924 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.218201 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.218572 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.218574 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.218575 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.218689 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.219300 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:55.219343 (+ 43us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:55.219474 (+ 131us) client_negotiation.cc:769] Sending connection context
0812 11:10:55.219618 (+ 144us) client_negotiation.cc:240] Negotiation successful
0812 11:10:55.220033 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":105,"thread_start_us":137,"threads_started":1}
I20260812 11:10:55.223579 28238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:10:55.224349 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.224049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38247 (local address 127.0.0.1:33540)
0812 11:10:55.224183 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.224253 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260812 11:10:55.224525 28134 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38247: connect: Connection refused (error 111)
I20260812 11:10:55.225312 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.225109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38247 (local address 127.0.0.1:33546)
0812 11:10:55.225208 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.225250 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260812 11:10:55.225435 28238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.253:38247: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38247: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.253.keytab.
Entry for principal kudu/127.18.174.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.253.keytab.
I20260812 11:10:55.233284 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.253:38247
--webserver_interface=127.18.174.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.253.keytab
--principal=kudu/127.18.174.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:36673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:35195,127.18.174.253:38247,127.18.174.252:41685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:10:55.274672 28238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } attempt: 1
I20260812 11:10:55.275585 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.275275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38247 (local address 127.0.0.1:33560)
0812 11:10:55.275430 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.275502 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 11:10:55.276300 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.276065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38247 (local address 127.0.0.1:33576)
0812 11:10:55.276185 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.276235 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 11:10:55.276420 28238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.253:38247: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38247: connect: Connection refused (error 111)
W20260812 11:10:55.344174 28248 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:10:55.344476 28248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:55.344517 28248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:55.344586 28248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 11:10:55.344578 28238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } attempt: 2
I20260812 11:10:55.345392 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.345098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38247 (local address 127.0.0.1:33584)
0812 11:10:55.345250 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.345313 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 11:10:55.346055 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.345842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38247 (local address 127.0.0.1:33586)
0812 11:10:55.345947 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.345995 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 11:10:55.346163 28238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.253:38247: Network error: Client connection negotiation failed: client connection to 127.18.174.253:38247: connect: Connection refused (error 111)
W20260812 11:10:55.348726 28248 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:55.348785 28248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:55.348816 28248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:55.348850 28248 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:55.348882 28248 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:55.354239 28248 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:35195,127.18.174.253:38247,127.18.174.252:41685
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.253.keytab
--principal=kudu/127.18.174.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.253:38247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.174.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:55.355386 28248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:55.356632 28248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:55.365048 28255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:55.365053 28256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:55.365053 28258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:55.365419 28248 server_base.cc:1034] running on GCE node
I20260812 11:10:55.365928 28248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:55.367134 28248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:55.368294 28248 hybrid_clock.cc:648] HybridClock initialized: now 1786533055368270 us; error 34 us; skew 500 ppm
Aug 12 11:10:55 dist-test-slave-lgr5 krb5kdc[28080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533055, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:55.370893 28248 init.cc:377] Logged in from keytab as kudu/127.18.174.253@KRBTEST.COM (short username kudu)
I20260812 11:10:55.371797 28248 webserver.cc:460] Webserver started at http://127.18.174.253:40321/ using document root <none> and password file <none>
I20260812 11:10:55.372386 28248 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:55.372454 28248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:55.372650 28248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:55.374661 28248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/data/instance:
uuid: "3c3ca585be8c49f48aa499685024a148"
format_stamp: "Formatted at 2026-08-12 11:10:55 on dist-test-slave-lgr5"
server_key: "033663b1888cb0be6cbb0bace885479f"
server_key_iv: "e53f43235c9c0de8a10ed60ee89bd9d0"
server_key_version: "encryptionkey@0"
I20260812 11:10:55.375229 28248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/wal/instance:
uuid: "3c3ca585be8c49f48aa499685024a148"
format_stamp: "Formatted at 2026-08-12 11:10:55 on dist-test-slave-lgr5"
server_key: "033663b1888cb0be6cbb0bace885479f"
server_key_iv: "e53f43235c9c0de8a10ed60ee89bd9d0"
server_key_version: "encryptionkey@0"
I20260812 11:10:55.378968 28248 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260812 11:10:55.381378 28270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:55.382543 28248 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 11:10:55.382656 28248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/wal
uuid: "3c3ca585be8c49f48aa499685024a148"
format_stamp: "Formatted at 2026-08-12 11:10:55 on dist-test-slave-lgr5"
server_key: "033663b1888cb0be6cbb0bace885479f"
server_key_iv: "e53f43235c9c0de8a10ed60ee89bd9d0"
server_key_version: "encryptionkey@0"
I20260812 11:10:55.382747 28248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:55.402937 28248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:55.405577 28248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:55.405748 28248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:55.412326 28248 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.253:38247
I20260812 11:10:55.412572 28373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.253:38247 every 8 connection(s)
I20260812 11:10:55.413237 28248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/data/info.pb
I20260812 11:10:55.415923 28377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:55.419373 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 28248
I20260812 11:10:55.419508 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-1/wal/instance
I20260812 11:10:55.419816 19131 external_mini_cluster.cc:1428] Setting key 291c499ba2a69a9446912186c2af6db5
I20260812 11:10:55.419761 28377 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.18.174.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.174.252@KRBTEST.COM" created.
Aug 12 11:10:55 dist-test-slave-lgr5 krb5kdc[28080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533055, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.253@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:55.436269 28242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.421894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41062 (local address 127.18.174.254:35195)
0812 11:10:55.422070 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.422075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.422860 (+ 785us) server_negotiation.cc:407] Connection header received
0812 11:10:55.423774 (+ 914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.423778 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.423841 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.423911 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.425122 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.425635 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.426724 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.426966 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.427058 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.432681 (+ 5623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.432685 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.432688 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.432719 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.434022 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.434641 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.434644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.434645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.434718 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.435105 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.435107 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.435108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.435283 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.435354 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.436005 (+ 651us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.436141 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:10:55.437305 28238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } attempt: 3
I20260812 11:10:55.437512 28383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.422250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:35195 (local address 127.0.0.1:41062)
0812 11:10:55.422705 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.422755 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:55.423575 (+ 820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:55.424113 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:55.424123 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:55.424527 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:55.424981 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.424994 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.425752 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.425756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.426605 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.426616 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.427104 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.427108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.427273 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.430707 (+ 3434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:55.430728 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:55.432496 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:55.434150 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.434157 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.434174 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.434544 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.434806 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.434809 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.434811 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.435014 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.435378 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:55.435384 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:55.435747 (+ 363us) client_negotiation.cc:769] Sending connection context
0812 11:10:55.435976 (+ 229us) client_negotiation.cc:240] Negotiation successful
0812 11:10:55.436357 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":101,"threads_started":1}
I20260812 11:10:55.439143 28377 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:10:55 dist-test-slave-lgr5 krb5kdc[28080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533055, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for kudu/127.18.174.253@KRBTEST.COM
Aug 12 11:10:55 dist-test-slave-lgr5 krb5kdc[28080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533055, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.253@KRBTEST.COM for kudu/127.18.174.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.174.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.252.keytab.
Entry for principal kudu/127.18.174.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.252.keytab.
I20260812 11:10:55.447134 19131 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
/tmp/dist-test-taskuq4X_z/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.252:41685
--webserver_interface=127.18.174.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.252.keytab
--principal=kudu/127.18.174.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.174.212:36673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.174.254:35195,127.18.174.253:38247,127.18.174.252:41685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:10:55.448480 28383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.439745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38247 (local address 127.0.0.1:33614)
0812 11:10:55.439829 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.439843 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:55.439944 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:55.440410 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:55.440414 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:55.440572 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:55.440688 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.440695 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.441759 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.441763 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.442364 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.442374 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.442883 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.442886 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.442966 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.443366 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:55.443376 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:55.444886 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:55.447090 (+ 2204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.447093 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.447094 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.447302 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.447535 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.447538 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.447540 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.447596 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.448004 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:55.448007 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:55.448109 (+ 102us) client_negotiation.cc:769] Sending connection context
0812 11:10:55.448204 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 11:10:55.448324 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260812 11:10:55.448541 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.437717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38247 (local address 127.0.0.1:33602)
0812 11:10:55.438183 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.438197 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:55.438267 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:55.439237 (+ 970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:55.439240 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:55.439385 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:55.439515 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.439522 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.440683 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.440687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.441903 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.441912 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.442500 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.442504 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.442607 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.443039 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:55.443053 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:55.444412 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:55.446958 (+ 2546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.446961 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.446963 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.447197 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.447506 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.447509 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.447511 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.447609 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.448059 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:55.448062 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:55.448183 (+ 121us) client_negotiation.cc:769] Sending connection context
0812 11:10:55.448260 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 11:10:55.448385 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389}
I20260812 11:10:55.448597 28391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.439897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33614 (local address 127.18.174.253:38247)
0812 11:10:55.440210 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.440218 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.440230 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:10:55.440261 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.440264 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.440299 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.440379 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.440790 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.441585 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.442573 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.442786 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.442872 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.445061 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.445066 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.445069 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.445095 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.446973 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.447389 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.447392 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.447393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.447455 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.447669 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.447672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.447673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.447904 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.448021 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.448296 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.448420 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":103,"threads_started":1}
I20260812 11:10:55.449148 28390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.438498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33602 (local address 127.18.174.253:38247)
0812 11:10:55.438831 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.438841 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.438859 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:10:55.438895 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.438899 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.439090 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.439223 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.439627 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.440582 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.442002 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.442389 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.442481 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.444585 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.444598 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.444614 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.444641 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.446860 (+ 2219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.447319 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.447325 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.447327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.447408 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.447723 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.447726 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.447728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.447935 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.448821 (+ 886us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.448883 (+ 62us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.448970 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":136,"threads_started":1}
I20260812 11:10:55.450729 28238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:10:55.450727 28377 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:10:55.451380 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.451144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:41685 (local address 127.0.0.1:56374)
0812 11:10:55.451273 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.451322 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 11:10:55.451669 28383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.451419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:41685 (local address 127.0.0.1:56382)
0812 11:10:55.451533 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.451609 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 11:10:55.451839 28278 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
I20260812 11:10:55.452067 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.451840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:41685 (local address 127.0.0.1:56398)
0812 11:10:55.451970 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.452016 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260812 11:10:55.452307 28238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:41685: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
I20260812 11:10:55.452704 28383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.452542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:41685 (local address 127.0.0.1:56414)
0812 11:10:55.452618 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.452658 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 11:10:55.452827 28377 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:41685: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
I20260812 11:10:55.483465 28238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } attempt: 1
I20260812 11:10:55.484417 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.483996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:41685 (local address 127.0.0.1:56426)
0812 11:10:55.484213 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.484304 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 11:10:55.485355 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.485079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:41685 (local address 127.0.0.1:56434)
0812 11:10:55.485205 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.485273 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 11:10:55.485548 28238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:41685: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
I20260812 11:10:55.502086 28377 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } attempt: 1
I20260812 11:10:55.503011 28383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.502685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:41685 (local address 127.0.0.1:56436)
0812 11:10:55.502864 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.502929 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 11:10:55.503712 28383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.503497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:41685 (local address 127.0.0.1:56444)
0812 11:10:55.503605 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.503654 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 11:10:55.503914 28377 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:41685: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
I20260812 11:10:55.560719 28238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } attempt: 2
I20260812 11:10:55.561483 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.561206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:41685 (local address 127.0.0.1:56446)
0812 11:10:55.561343 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.561402 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260812 11:10:55.562264 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.562065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:41685 (local address 127.0.0.1:56456)
0812 11:10:55.562164 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.562209 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260812 11:10:55.562676 28238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:41685: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
W20260812 11:10:55.564978 28392 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:10:55.565220 28392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:55.565248 28392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:55.565285 28392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:55.569175 28392 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:55.569226 28392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:55.569244 28392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:55.569265 28392 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:55.569279 28392 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:55.572057 28377 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } attempt: 2
I20260812 11:10:55.572703 28383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.572450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:41685 (local address 127.0.0.1:56460)
0812 11:10:55.572587 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.572638 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260812 11:10:55.573364 28383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.573184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:41685 (local address 127.0.0.1:56466)
0812 11:10:55.573268 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.573309 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 11:10:55.573498 28377 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.174.252:41685: Network error: Client connection negotiation failed: client connection to 127.18.174.252:41685: connect: Connection refused (error 111)
I20260812 11:10:55.574573 28392 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.174.212:36673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.174.254:35195,127.18.174.253:38247,127.18.174.252:41685
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/krb5kdc/kudu_127.18.174.252.keytab
--principal=kudu/127.18.174.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.174.252:41685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.174.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 09:58:34 UTC on ccycloud.quasar-qfmjiv.root.comops.site
build id 4582284
I20260812 11:10:55.575595 28392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:55.576634 28392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:55.584632 28401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:55.584688 28399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:55.584647 28406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:55.584700 28392 server_base.cc:1034] running on GCE node
I20260812 11:10:55.585422 28392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:55.586521 28392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:55.587706 28392 hybrid_clock.cc:648] HybridClock initialized: now 1786533055587686 us; error 32 us; skew 500 ppm
Aug 12 11:10:55 dist-test-slave-lgr5 krb5kdc[28080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533055, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:55.590284 28392 init.cc:377] Logged in from keytab as kudu/127.18.174.252@KRBTEST.COM (short username kudu)
I20260812 11:10:55.591130 28392 webserver.cc:460] Webserver started at http://127.18.174.252:46433/ using document root <none> and password file <none>
I20260812 11:10:55.591663 28392 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:55.591728 28392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:55.591929 28392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:55.593942 28392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/data/instance:
uuid: "41f6ee9bb39f44e181ab81e693638bd0"
format_stamp: "Formatted at 2026-08-12 11:10:55 on dist-test-slave-lgr5"
server_key: "7fdea22caf98ac8c6727fa921ee72d14"
server_key_iv: "6f350b685f0de8c62883cecf7a27f7d7"
server_key_version: "encryptionkey@0"
I20260812 11:10:55.594487 28392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/wal/instance:
uuid: "41f6ee9bb39f44e181ab81e693638bd0"
format_stamp: "Formatted at 2026-08-12 11:10:55 on dist-test-slave-lgr5"
server_key: "7fdea22caf98ac8c6727fa921ee72d14"
server_key_iv: "6f350b685f0de8c62883cecf7a27f7d7"
server_key_version: "encryptionkey@0"
I20260812 11:10:55.598181 28392 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260812 11:10:55.600569 28416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:55.601706 28392 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:55.601819 28392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/data,/tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/wal
uuid: "41f6ee9bb39f44e181ab81e693638bd0"
format_stamp: "Formatted at 2026-08-12 11:10:55 on dist-test-slave-lgr5"
server_key: "7fdea22caf98ac8c6727fa921ee72d14"
server_key_iv: "6f350b685f0de8c62883cecf7a27f7d7"
server_key_version: "encryptionkey@0"
I20260812 11:10:55.601910 28392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:55.611366 28392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:55.614158 28392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:55.614338 28392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:55.621335 28392 rpc_server.cc:307] RPC server started. Bound to: 127.18.174.252:41685
I20260812 11:10:55.621590 28525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.174.252:41685 every 8 connection(s)
I20260812 11:10:55.622327 28392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/data/info.pb
I20260812 11:10:55.625111 28526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:55.625787 19131 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu as pid 28392
I20260812 11:10:55.625906 19131 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskuq4X_z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532756485707-19131-0/minicluster-data/master-2/wal/instance
I20260812 11:10:55.626194 19131 external_mini_cluster.cc:1428] Setting key 55f4880685b286a64d0dd0b834cd073e
I20260812 11:10:55.629520 28526 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:10:55 dist-test-slave-lgr5 krb5kdc[28080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.252@KRBTEST.COM
Aug 12 11:10:55 dist-test-slave-lgr5 krb5kdc[28080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533055, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.252@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:55.640206 28242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.631426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41074 (local address 127.18.174.254:35195)
0812 11:10:55.631576 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.631581 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.631842 (+ 261us) server_negotiation.cc:407] Connection header received
0812 11:10:55.632022 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.632025 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.632068 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.632166 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.632848 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.633358 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.634335 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.634705 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.634818 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.637041 (+ 2223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.637044 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.637046 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.637072 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.638285 (+ 1213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.638715 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.638718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.638720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.638794 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.639035 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.639039 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.639040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.639264 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.639352 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.639856 (+ 504us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.639986 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 11:10:55.640801 28531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.627547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56474 (local address 127.18.174.252:41685)
0812 11:10:55.627995 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.628018 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.628062 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:10:55.628903 (+ 841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.628928 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.629374 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.629742 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.630439 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.631697 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.632647 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.633201 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.633322 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.636135 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.636141 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.636152 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.636174 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.637858 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.638275 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.638281 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.638286 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.638391 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.638655 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.638658 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.638660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.639077 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.639307 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.639590 (+ 283us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.639906 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":290,"spinlock_wait_cycles":768,"thread_start_us":114,"threads_started":1}
I20260812 11:10:55.640800 28532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.631353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.254:35195 (local address 127.0.0.1:41074)
0812 11:10:55.631730 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.631778 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:55.631918 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:55.632220 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:55.632226 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:55.632576 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:55.632728 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.632734 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.633485 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.633488 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.634205 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.634215 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.634856 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.634860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.634946 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.635461 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:55.635482 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:55.636891 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:55.638385 (+ 1494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.638394 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.638401 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.638621 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.638876 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.638879 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.638881 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.638958 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.639367 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:55.639374 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:55.639511 (+ 137us) client_negotiation.cc:769] Sending connection context
0812 11:10:55.639632 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 11:10:55.639985 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":94,"thread_start_us":99,"threads_started":1}
I20260812 11:10:55.642096 28526 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:10:55 dist-test-slave-lgr5 krb5kdc[28080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533055, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.252@KRBTEST.COM for kudu/127.18.174.253@KRBTEST.COM
Aug 12 11:10:55 dist-test-slave-lgr5 krb5kdc[28080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.254@KRBTEST.COM
I20260812 11:10:55.650025 28532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.642567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.253:38247 (local address 127.0.0.1:33630)
0812 11:10:55.642731 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.642744 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:55.642808 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:55.643142 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:55.643144 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:55.643270 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:55.643355 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.643359 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.644116 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.644120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.644616 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.644623 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.645057 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.645060 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.645157 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.645555 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:55.645566 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:55.646938 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:55.648628 (+ 1690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.648631 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.648634 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.648861 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.649111 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.649114 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.649116 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.649203 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.649570 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:55.649573 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:55.649655 (+ 82us) client_negotiation.cc:769] Sending connection context
0812 11:10:55.649743 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 11:10:55.649869 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99}
I20260812 11:10:55.650061 28390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.642683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33630 (local address 127.18.174.253:38247)
0812 11:10:55.642812 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.642816 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.642848 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:10:55.642894 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.642897 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.642949 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.643031 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.643474 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.643992 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.644727 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.644958 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.645048 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.647075 (+ 2027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.647079 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.647082 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.647108 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.648527 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.648948 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.648951 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.648952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.649027 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.649280 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.649282 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.649283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.649459 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.649577 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.649818 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.649918 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:10:55.650728 28526 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:10:55.651021 28242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.642974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41086 (local address 127.18.174.254:35195)
0812 11:10:55.643075 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.643079 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.643126 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:10:55.643240 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.643243 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.643283 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.643343 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.643892 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.644416 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.645129 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.645338 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.645417 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.647895 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.647899 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.647901 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.647924 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.649354 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.649804 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.649807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.649809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.649894 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.650203 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.650207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.650208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.650412 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.650619 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.650765 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.650873 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Aug 12 11:10:55 dist-test-slave-lgr5 krb5kdc[28080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533055, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.252@KRBTEST.COM for kudu/127.18.174.252@KRBTEST.COM
Aug 12 11:10:55 dist-test-slave-lgr5 krb5kdc[28080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.174.253@KRBTEST.COM
I20260812 11:10:55.658641 28531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.651409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56480 (local address 127.18.174.252:41685)
0812 11:10:55.651519 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.651522 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.651554 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:10:55.651585 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.651588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.651628 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.651696 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.652240 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.652704 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.653370 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.653579 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.653659 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.655757 (+ 2098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.655760 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.655762 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.655782 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.657060 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.657509 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.657512 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.657513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.657591 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.657857 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.657859 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.657860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.658019 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.658099 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.658395 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.658522 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":41}
I20260812 11:10:55.658645 28532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.651216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:41685 (local address 127.0.0.1:56480)
0812 11:10:55.651414 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.651426 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:55.651492 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:55.651892 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:55.651894 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:55.652028 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:55.652133 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.652139 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.652796 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.652799 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.653275 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.653282 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.653666 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.653669 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.653773 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.654188 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:55.654201 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:55.655635 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:55.657165 (+ 1530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.657167 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.657169 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.657413 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.657681 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.657684 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.657686 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.657774 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.658117 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:55.658121 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:55.658218 (+ 97us) client_negotiation.cc:769] Sending connection context
0812 11:10:55.658333 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 11:10:55.658460 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":18}
I20260812 11:10:55.660118 28390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.652134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33636 (local address 127.18.174.253:38247)
0812 11:10:55.652235 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.652239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.652251 (+ 12us) server_negotiation.cc:407] Connection header received
0812 11:10:55.652284 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.652287 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.652323 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.652387 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.652928 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.653384 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.654135 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.654447 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.654567 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.656899 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.656903 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.656906 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.656928 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.658442 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.658867 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.658871 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.658873 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.658963 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.659236 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.659240 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.659241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.659407 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.659611 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.659738 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.659988 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 11:10:55.661821 28238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } attempt: 3
I20260812 11:10:55.662528 28526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0: Bootstrap starting.
I20260812 11:10:55.663383 19131 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:55.664644 28377 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } attempt: 3
I20260812 11:10:55.664443 28185 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "5754c9cf103148e7b04fad7609c775b2"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41086
I20260812 11:10:55.666007 28526 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:55.666893 28526 log.cc:824] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:10:55 dist-test-slave-lgr5 krb5kdc[28080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533055, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.254@KRBTEST.COM for kudu/127.18.174.252@KRBTEST.COM
I20260812 11:10:55.669621 28526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0: No bootstrap required, opened a new log
Aug 12 11:10:55 dist-test-slave-lgr5 krb5kdc[28080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533055, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.174.253@KRBTEST.COM for kudu/127.18.174.252@KRBTEST.COM
I20260812 11:10:55.671180 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.662216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:41685 (local address 127.0.0.1:56484)
0812 11:10:55.662335 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.662349 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:55.662428 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:55.662874 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:55.662877 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:55.663053 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:55.663157 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.663164 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.664196 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.664199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.664963 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.664974 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.665510 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.665514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.665597 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.666074 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:55.666088 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:55.667550 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:55.669560 (+ 2010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.669564 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.669566 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.669810 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.670142 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.670145 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.670147 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.670241 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.670696 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:55.670699 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:55.670798 (+ 99us) client_negotiation.cc:769] Sending connection context
0812 11:10:55.670874 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 11:10:55.671014 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 11:10:55.671797 28531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.662551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56484 (local address 127.18.174.252:41685)
0812 11:10:55.662666 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.662670 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.662681 (+ 11us) server_negotiation.cc:407] Connection header received
0812 11:10:55.662710 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.662713 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.662751 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.663261 (+ 510us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.663340 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.664023 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.665099 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.665391 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.665493 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.667680 (+ 2187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.667684 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.667687 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.667709 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.669227 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.669925 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.669929 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.669931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.670030 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.670349 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.670352 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.670354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.670579 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.671450 (+ 871us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.671527 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.671660 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:10:55.673666 28526 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } }
I20260812 11:10:55.673916 28526 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f6ee9bb39f44e181ab81e693638bd0, State: Initialized, Role: FOLLOWER
I20260812 11:10:55.674255 28526 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } }
I20260812 11:10:55.674468 28535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.665708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56500 (local address 127.18.174.252:41685)
0812 11:10:55.666009 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.666019 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.666032 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:10:55.666065 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.666068 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.666105 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.666631 (+ 526us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.666712 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.667271 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.668388 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.668999 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.669092 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.671074 (+ 1982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.671078 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.671080 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.671103 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.672715 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.673189 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.673193 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.673194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.673277 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.673577 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.673581 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.673583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.673777 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.673875 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.674187 (+ 312us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.674293 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":100,"threads_started":1}
I20260812 11:10:55.674582 28383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.665016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.174.252:41685 (local address 127.0.0.1:56500)
0812 11:10:55.665176 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:55.665188 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:55.665250 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:55.666249 (+ 999us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:55.666252 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:55.666406 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:55.666515 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.666523 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.667433 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.667437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.668270 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:55.668282 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.669103 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.669107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:55.669190 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.669571 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:55.669584 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:55.670936 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:55.672824 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.672828 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.672830 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.673085 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.673374 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:55.673377 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:55.673379 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:55.673486 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:55.673877 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:55.673880 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:55.674013 (+ 133us) client_negotiation.cc:769] Sending connection context
0812 11:10:55.674119 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 11:10:55.674243 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98}
I20260812 11:10:55.674798 28238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2: Bootstrap starting.
I20260812 11:10:55.675699 28526 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:55.677330 28238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:55.677699 28377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148: Bootstrap starting.
I20260812 11:10:55.678646 28238 log.cc:824] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:55.680325 28377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:55.680843 28238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2: No bootstrap required, opened a new log
I20260812 11:10:55.681282 28377 log.cc:824] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148: Log is configured to *not* fsync() on all Append() calls
W20260812 11:10:55.682842 28562 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:10:55.682951 28562 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:10:55.683246 28377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148: No bootstrap required, opened a new log
I20260812 11:10:55.679684 28392 master_runner.cc:186] Error getting master registration for 127.18.174.254:35195: OK, instance_id { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" instance_seqno: 1786533055195896 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:10:55.683429 28392 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:10:55.683808 28238 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } }
I20260812 11:10:55.684008 28238 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5754c9cf103148e7b04fad7609c775b2, State: Initialized, Role: FOLLOWER
I20260812 11:10:55.684432 28238 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } }
I20260812 11:10:55.684921 28572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } } }
I20260812 11:10:55.685067 28572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:55.685710 28238 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:55.685777 28185 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 11:10:55.685866 28185 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:55.686592 28377 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } }
I20260812 11:10:55.686789 28377 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3ca585be8c49f48aa499685024a148, State: Initialized, Role: FOLLOWER
I20260812 11:10:55.687036 28377 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } }
I20260812 11:10:55.687090 28185 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } }
I20260812 11:10:55.687997 28537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } } }
I20260812 11:10:55.688062 28185 leader_election.cc:288] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [CANDIDATE]: Term 1 election: Requested vote from peers 3c3ca585be8c49f48aa499685024a148 (127.18.174.253:38247), 41f6ee9bb39f44e181ab81e693638bd0 (127.18.174.252:41685)
I20260812 11:10:55.688140 28537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:55.689118 28474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5754c9cf103148e7b04fad7609c775b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "41f6ee9bb39f44e181ab81e693638bd0"
I20260812 11:10:55.689333 28474 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:55.690636 28474 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5754c9cf103148e7b04fad7609c775b2 in term 1.
W20260812 11:10:55.690685 28592 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:10:55.690749 28592 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:10:55.691056 28134 leader_election.cc:302] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f6ee9bb39f44e181ab81e693638bd0, 5754c9cf103148e7b04fad7609c775b2; no voters:
I20260812 11:10:55.691493 28572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:55.691702 28572 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [term 1 LEADER]: Becoming Leader. State: Replica: 5754c9cf103148e7b04fad7609c775b2, State: Running, Role: LEADER
I20260812 11:10:55.692036 28572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } }
I20260812 11:10:55.692420 28324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5754c9cf103148e7b04fad7609c775b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3c3ca585be8c49f48aa499685024a148"
I20260812 11:10:55.692687 28324 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:55.693943 28324 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5754c9cf103148e7b04fad7609c775b2 in term 1.
I20260812 11:10:55.693914 28572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5754c9cf103148e7b04fad7609c775b2. Latest consensus state: current_term: 1 leader_uuid: "5754c9cf103148e7b04fad7609c775b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } } }
I20260812 11:10:55.694020 28572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:55.691958 28377 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 11:10:55.694720 28139 tablet.cc:2369] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:55.696817 28617 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:55.697727 28617 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:55.697055 28099 master_runner.cc:186] Error getting master registration for 127.18.174.253:38247: OK, instance_id { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" instance_seqno: 1786533055410543 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:10:55.700476 28099 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:10:55.704893 28583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } } }
I20260812 11:10:55.705076 28583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 11:10:55.706669 28635 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:10:55.706748 28635 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:10:55.708745 28242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.690498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41094 (local address 127.18.174.254:35195)
0812 11:10:55.690613 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.690617 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.692815 (+ 2198us) server_negotiation.cc:407] Connection header received
0812 11:10:55.693083 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.693087 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.693140 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.693191 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.695754 (+ 2563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.696560 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.699986 (+ 3426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.700352 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.700431 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.703597 (+ 3166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.703600 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.703603 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.703628 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.706563 (+ 2935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.707356 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.707360 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.707361 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.707450 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.707756 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.707760 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.707761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.707989 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.708130 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.708491 (+ 361us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.708596 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:10:55.712589 28535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.692142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56510 (local address 127.18.174.252:41685)
0812 11:10:55.692252 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.692256 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.701449 (+ 9193us) server_negotiation.cc:407] Connection header received
0812 11:10:55.701641 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.701644 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.701697 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.701748 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.703351 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.704316 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.705611 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.705948 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.706028 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.708706 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.708709 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.708712 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.708736 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.710289 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.710762 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.710766 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.710767 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.710852 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.711137 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.711140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.711142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.711606 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.711722 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.712311 (+ 589us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.712421 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:10:55.715550 28390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.691358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33638 (local address 127.18.174.253:38247)
0812 11:10:55.691467 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.691472 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.694303 (+ 2831us) server_negotiation.cc:407] Connection header received
0812 11:10:55.694524 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.694527 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.694578 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.694625 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.697903 (+ 3278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.698829 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.701046 (+ 2217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.701369 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.701444 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.711059 (+ 9615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.711063 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.711065 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.711092 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.712582 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.714170 (+ 1588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.714175 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.714177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.714262 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.714563 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.714566 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.714568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.714771 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.714885 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.715255 (+ 370us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.715396 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:10:55.720719 28324 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148 [term 1 FOLLOWER]: Refusing update from remote peer 5754c9cf103148e7b04fad7609c775b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:55.721771 28474 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0 [term 1 FOLLOWER]: Refusing update from remote peer 5754c9cf103148e7b04fad7609c775b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:55.722512 28606 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:55.722680 28572 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:55.727559 28537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5754c9cf103148e7b04fad7609c775b2. Latest consensus state: current_term: 1 leader_uuid: "5754c9cf103148e7b04fad7609c775b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } } }
I20260812 11:10:55.727559 28583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5754c9cf103148e7b04fad7609c775b2. Latest consensus state: current_term: 1 leader_uuid: "5754c9cf103148e7b04fad7609c775b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } } }
I20260812 11:10:55.727696 28537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:55.727696 28583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:55.730527 28606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5754c9cf103148e7b04fad7609c775b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } } }
I20260812 11:10:55.730674 28606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:55.731772 28537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5754c9cf103148e7b04fad7609c775b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } } }
I20260812 11:10:55.731899 28537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:55.732308 28636 mvcc.cc:205] Tried to move back new op lower bound from 7317639396223406080 to 7317639396118310912. Current Snapshot: MvccSnapshot[applied={T|T < 7317639396223406080}]
I20260812 11:10:55.734534 28640 mvcc.cc:205] Tried to move back new op lower bound from 7317639396223406080 to 7317639396118310912. Current Snapshot: MvccSnapshot[applied={T|T < 7317639396223406080}]
I20260812 11:10:55.736435 28617 catalog_manager.cc:1347] Generated new cluster ID: e24e691ff2e24d718afed33cc0d7b0eb
I20260812 11:10:55.736500 28617 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:55.739503 28572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5754c9cf103148e7b04fad7609c775b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } } }
I20260812 11:10:55.739619 28572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:55.740669 28583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5754c9cf103148e7b04fad7609c775b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5754c9cf103148e7b04fad7609c775b2" member_type: VOTER last_known_addr { host: "127.18.174.254" port: 35195 } } peers { permanent_uuid: "3c3ca585be8c49f48aa499685024a148" member_type: VOTER last_known_addr { host: "127.18.174.253" port: 38247 } } peers { permanent_uuid: "41f6ee9bb39f44e181ab81e693638bd0" member_type: VOTER last_known_addr { host: "127.18.174.252" port: 41685 } } }
I20260812 11:10:55.740778 28583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:55.741217 28639 mvcc.cc:205] Tried to move back new op lower bound from 7317639396223406080 to 7317639396118310912. Current Snapshot: MvccSnapshot[applied={T|T < 7317639396223406080}]
I20260812 11:10:55.752878 28617 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:55.754129 28617 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:55.773376 28617 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5754c9cf103148e7b04fad7609c775b2: Generated new TSK 0
I20260812 11:10:55.774258 28617 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:10:55.813418 28242 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:55.809637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41100 (local address 127.18.174.254:35195)
0812 11:10:55.809787 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.809792 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.811851 (+ 2059us) server_negotiation.cc:407] Connection header received
0812 11:10:55.812413 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.812418 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.812482 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.812542 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.813262 (+ 720us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41100: BlockingRecv error: recv got EOF from 127.0.0.1:41100 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260812 11:10:55.814656 28390 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:55.810458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33644 (local address 127.18.174.253:38247)
0812 11:10:55.810582 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.810588 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.812241 (+ 1653us) server_negotiation.cc:407] Connection header received
0812 11:10:55.813821 (+ 1580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.813825 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.813879 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.813933 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.814527 (+ 594us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33644: BlockingRecv error: recv got EOF from 127.0.0.1:33644 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 11:10:55.816572 28535 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:55.811153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56524 (local address 127.18.174.252:41685)
0812 11:10:55.811291 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.811296 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.815098 (+ 3802us) server_negotiation.cc:407] Connection header received
0812 11:10:55.815692 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.815696 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.815752 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.815811 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.816446 (+ 635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56524: BlockingRecv error: recv got EOF from 127.0.0.1:56524 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 11:10:55.821297 28390 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:55.819649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33650 (local address 127.18.174.253:38247)
0812 11:10:55.819758 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.819763 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.820305 (+ 542us) server_negotiation.cc:407] Connection header received
0812 11:10:55.820537 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.820540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.820620 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.820674 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.821170 (+ 496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33650: BlockingRecv error: recv got EOF from 127.0.0.1:33650 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260812 11:10:55.826496 28390 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:55.824878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33662 (local address 127.18.174.253:38247)
0812 11:10:55.824982 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.824986 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.825557 (+ 571us) server_negotiation.cc:407] Connection header received
0812 11:10:55.825750 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.825754 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.825809 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.825866 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.826392 (+ 526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33662: BlockingRecv error: recv got EOF from 127.0.0.1:33662 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260812 11:10:55.832368 28390 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:55.830569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33668 (local address 127.18.174.253:38247)
0812 11:10:55.830676 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.830681 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.831266 (+ 585us) server_negotiation.cc:407] Connection header received
0812 11:10:55.831469 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.831472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.831527 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.831583 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.832216 (+ 633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33668: BlockingRecv error: recv got EOF from 127.0.0.1:33668 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260812 11:10:55.840279 28390 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:55.838527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33684 (local address 127.18.174.253:38247)
0812 11:10:55.838671 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.838676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.839242 (+ 566us) server_negotiation.cc:407] Connection header received
0812 11:10:55.839466 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.839469 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.839524 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.839579 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.840157 (+ 578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33684: BlockingRecv error: recv got EOF from 127.0.0.1:33684 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260812 11:10:55.852680 28390 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:55.850681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33694 (local address 127.18.174.253:38247)
0812 11:10:55.850818 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.850824 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.851504 (+ 680us) server_negotiation.cc:407] Connection header received
0812 11:10:55.851757 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.851762 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.851825 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.851887 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.852555 (+ 668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33694: BlockingRecv error: recv got EOF from 127.0.0.1:33694 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260812 11:10:55.873349 28390 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:55.871282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33702 (local address 127.18.174.253:38247)
0812 11:10:55.871416 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.871421 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.872173 (+ 752us) server_negotiation.cc:407] Connection header received
0812 11:10:55.872459 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.872463 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.872533 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.872594 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.873203 (+ 609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33702: BlockingRecv error: recv got EOF from 127.0.0.1:33702 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260812 11:10:55.909248 28390 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:55.908017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33714 (local address 127.18.174.253:38247)
0812 11:10:55.908157 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.908161 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.908384 (+ 223us) server_negotiation.cc:407] Connection header received
0812 11:10:55.908528 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.908531 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.908580 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.908651 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.909125 (+ 474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33714: BlockingRecv error: recv got EOF from 127.0.0.1:33714 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260812 11:10:55.983985 28390 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:55.975693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33724 (local address 127.18.174.253:38247)
0812 11:10:55.975853 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.975858 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.983110 (+ 7252us) server_negotiation.cc:407] Connection header received
0812 11:10:55.983237 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.983241 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.983310 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.983402 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.983872 (+ 470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33724: BlockingRecv error: recv got EOF from 127.0.0.1:33724 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 11:10:56.115067 28390 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:56.114030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33726 (local address 127.18.174.253:38247)
0812 11:10:56.114202 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:56.114206 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:56.114281 (+ 75us) server_negotiation.cc:407] Connection header received
0812 11:10:56.114408 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:56.114411 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:56.114461 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:56.114532 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:56.114922 (+ 390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33726: BlockingRecv error: recv got EOF from 127.0.0.1:33726 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260812 11:10:56.374509 28390 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:56.373333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33742 (local address 127.18.174.253:38247)
0812 11:10:56.373497 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:56.373503 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:56.373616 (+ 113us) server_negotiation.cc:407] Connection header received
0812 11:10:56.373777 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:56.373780 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:56.373843 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:56.373915 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:56.374387 (+ 472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33742: BlockingRecv error: recv got EOF from 127.0.0.1:33742 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:10:56.684464 28562 catalog_manager.cc:1259] Loaded cluster ID: e24e691ff2e24d718afed33cc0d7b0eb
I20260812 11:10:56.684554 28562 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0: loading cluster ID for follower catalog manager: success
I20260812 11:10:56.686476 28562 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0: acquiring CA information for follower catalog manager: success
I20260812 11:10:56.687791 28562 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 41f6ee9bb39f44e181ab81e693638bd0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:10:56.708037 28635 catalog_manager.cc:1259] Loaded cluster ID: e24e691ff2e24d718afed33cc0d7b0eb
I20260812 11:10:56.708141 28635 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148: loading cluster ID for follower catalog manager: success
I20260812 11:10:56.709846 28635 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148: acquiring CA information for follower catalog manager: success
I20260812 11:10:56.711004 28635 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3c3ca585be8c49f48aa499685024a148: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:10:56.892648 28783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:56.888676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33754 (local address 127.18.174.253:38247)
0812 11:10:56.888950 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:56.888955 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:56.888978 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:10:56.889168 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:56.889171 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:56.889305 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:56.889406 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:56.889685 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.890217 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.891099 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.891332 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.891422 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:56.891750 (+ 328us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:56.892262 (+ 512us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:56.892376 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:56.892433 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 11:10:56.892493 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":92,"threads_started":1}
I20260812 11:10:56.899029 28794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:56.895539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56528 (local address 127.18.174.252:41685)
0812 11:10:56.895770 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:56.895774 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:56.895788 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:10:56.895889 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:56.895892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:56.896015 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:56.896164 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:56.896367 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.896868 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.897653 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.897875 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.897960 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:56.898251 (+ 291us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:56.898655 (+ 404us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:56.898761 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:56.898834 (+ 73us) server_negotiation.cc:299] Negotiation successful
0812 11:10:56.898886 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":61,"threads_started":1}
I20260812 11:10:56.905601 28783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:56.901910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33756 (local address 127.18.174.253:38247)
0812 11:10:56.902032 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:56.902036 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:56.902245 (+ 209us) server_negotiation.cc:407] Connection header received
0812 11:10:56.902438 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:56.902441 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:56.902507 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:56.902574 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:56.902791 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.903276 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.904441 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.904739 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.904842 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:56.905116 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:56.905199 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:56.905276 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:56.905390 (+ 114us) server_negotiation.cc:299] Negotiation successful
0812 11:10:56.905461 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:10:56.906189 28804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:56.901682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41110 (local address 127.18.174.254:35195)
0812 11:10:56.901939 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:56.901943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:56.901956 (+ 13us) server_negotiation.cc:407] Connection header received
0812 11:10:56.902042 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:56.902045 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:56.902206 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:56.902325 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:56.902671 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.903440 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.904537 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.904855 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.904946 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:56.905224 (+ 278us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:56.905628 (+ 404us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:56.905705 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:56.905982 (+ 277us) server_negotiation.cc:299] Negotiation successful
0812 11:10:56.906044 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":85,"threads_started":1}
I20260812 11:10:56.906291 28794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:56.902244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56542 (local address 127.18.174.252:41685)
0812 11:10:56.902370 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:56.902375 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:56.902511 (+ 136us) server_negotiation.cc:407] Connection header received
0812 11:10:56.902643 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:56.902647 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:56.902693 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:56.902735 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:56.903079 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.903704 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.905138 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.905449 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.905520 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:56.905910 (+ 390us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:56.905988 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:56.906055 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:56.906139 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 11:10:56.906183 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:10:56.909139 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 28099
I20260812 11:10:56.921170 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 28248
I20260812 11:10:56.932578 19131 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskuq4X_z/build/debug/bin/kudu with pid 28392
2026-08-12T11:10:56Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3202 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6413 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (300405 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST